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About this practice guide 

The Institute of Education Sciences (IES) publishes practice guides to provide educators with the best 
available evidence and expertise on current challenges in education. The What Works Clearinghouse 
(WWC) develops practice guides in conjunction with an expert panel, combining the panel’s expertise 
with the findings of existing rigorous research to produce specific recommendations for addressing 
these challenges. The WWC and the panel rate the strength of the research evidence supporting each 
of their recommendations. See Appendix A for a full description of practice guides and Appendix D 
for a full list of the studies used to support the evidence rating for each recommendation. 

The goal of this practice guide is to offer educators specific, evidence-based recommendations that 
address the challenges of preventing dropout in secondary schools. This guide synthesizes the best 
publicly available research and shares practices that are supported by evidence. It is intended to be prac¬ 
tical and easy for teachers and school leaders to use. 

The guide includes many examples in each recommendation to demonstrate the concepts discussed. 
Throughout the guide, examples, definitions, and other concepts supported by evidence are indicated 
by endnotes within the example title or content. For examples that are supported by studies that 
meet WWC design standards, the citation in the endnote is in bold text. Examples without specific 
citations were developed in conjunction with the expert panel based on their experience, expertise, 
and knowledge of the related literature. Practice guides published by IES are available on the WWC 
website at https://whatworks.ed.gov. 

How to use this guide 

This guide is targeted to school and district administrators, as well as members of student-support 
teams including school counselors, social workers, psychologists, and teachers. It provides recommen¬ 
dations that can be implemented in conjunction with existing academic curricula and student-support 
services. No single recommendation is likely to prevent dropout entirely on its own, because each 
addresses different types of student needs and challenges. The panel believes that Recommendations 
1, 2, and 3 complement one another and are most effective when implemented simultaneously in all 
types of schools. Recommendation 4 should be implemented primarily in schools with high dropout 
rates to facilitate implementation of the other three recommendations. It is important to note that 
Recommendation 4 might be more challenging to implement, as it could involve staffing and other 
structural changes in the school. 

While the guide uses specific examples to illustrate how the recommendations can be implemented, 
there are a wide range of activities that could be used to implement the recommended practices. The 
type of activity may vary depending on school context, grade range, and other support available at 
the school. In addition, activities may vary depending on budget limitations. The panel did not explic¬ 
itly consider financial costs of implementing the recommendations, but some of the recommended 
practices, such as hiring individuals to serve as advocates or planning and implementing small learn¬ 
ing communities, may require expenditures. 1 

Practitioners in after-school or community-based programs may also be able to adapt some of the 
recommended practices to non-school settings, but the specific activities implemented in these types 
of settings might differ from those used during the school day. 

Professional development providers, researchers, and state level administrators and policymakers can also 
use this guide. Professional development providers can use the guide to encourage the use of evidence- 
based practices or to prompt discussions about dropout prevention strategies in professional learning 
communities. Researchers may find opportunities to test the effectiveness of various approaches and 
explore gaps or variations in the dropout prevention literature. State level officials can use the guide 
to support or facilitate the recommended practices within districts, schools, and affiliated programs. 
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Introduction 


Introduction to the Preventing Dropout in Secondary Schools 
Practice Guide 


D ropping out of secondary school is a 
persistent and serious problem. 2 More 
than half a million high school students stop 
attending school each year, 3 and students 
who do not complete high school face eco¬ 
nomic and social challenges throughout their 
lifetimes. They are more likely to be unem¬ 
ployed, 4 and those who are employed have 
lower earnings than high school graduates of 
the same age. 5 They are also more likely to 
have poor health, engage in criminal activity, 
and require public assistance. 6 


Dropout: A Persistent Problem 

■ The percentage of 15- to 24-year-olds 
in grades 10-12 who dropped out of 
school in 2015 has fallen less than one 
percentage point in the last 50 years 
(to 4.7%). 

■ In 2015, the annual dropout rates for 
blacks and Hispanics were more than 
a percentage point higher than for 
whites (5.8% and 5.7%, respectively, 
compared to 4.5%). 

■ In 2015, students from low-income 
families dropped out at more than 
twice the rate of their peers from 
high-income families (7.2% compared 
to 5.0%). 7 


This practice guide provides school educa¬ 
tors and administrators with four evidence- 
based recommendations for reducing 
dropout rates in middle and high schools and 
improving high school graduation rates. Each 
recommendation provides specific, actionable 
strategies; examples of how to implement the 
recommended practices in schools; advice on 
how to overcome potential obstacles; and a 
description of the supporting evidence. 


The guide was developed in conjunction 
with a panel of dropout prevention research¬ 
ers and practitioners with experience in 
researching, developing, and implementing 
dropout prevention strategies. It combines 
the panel’s expertise with the findings of 
existing rigorous research. 


See the Glossary for a full list of key 
terms used in this guide and their 
definitions. These terms are bolded 
when first introduced. 


This practice guide updates Dropout Preven¬ 
tion: A Practice Guide, published in 2008. 8 

This updated guide reflects the following: 

■ Improvements in monitoring at-risk 
students. There have been significant 
advances in using early warning indicators 
to identify students at risk for dropping 
out, to monitor students who require 
intervention, and to intervene to help 
students manage challenges and stay 
engaged in school. 9 

■ Recent evidence on dropout preven¬ 
tion practices, assessed using more 
rigorous standards. This guide consid¬ 
ers research published between January 
1987 and January 2016, which covers 

an additional 9 years after the previous 
guide’s literature search was conducted 
in 2007. Fifteen of the 25 studies used 
to support recommendations in this 
updated guide were published after 
2007. In addition, studies in the previ¬ 
ous guide—reviewed under What Works 
Clearinghouse (WWC) evidence standards, 
version 1.0—were reviewed again using 
the current, more rigorous WWC evidence 
standards, version 5.0. 10 
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Overarching themes 

Three important themes emerge for prevent¬ 
ing dropout in secondary schools: 

■ Continual monitoring of school and student 
data to identify when and where interven¬ 
tions should be applied prevents students 
from falling off track for graduation. 

■ Different students require different types of 
support to keep them engaged in school. 

■ A personalized learning environment 
facilitates stronger relationships between 
staff and students and engaging students 
in school. 


Dropout and Graduation 

The ultimate objective of dropout pre¬ 
vention strategies is high school gradu¬ 
ation, but there are critical intermediate 
steps on the path to graduation. Students 
must enroll in school, attend school, 
and progress in school before eventually 
earning a diploma. 

A number of indicators are commonly 
used to monitor progress on this pathway 
for a given population at any point in time: 

■ Dropout rate. The percentage of 
students who are not enrolled in 
school and have not earned a regular 
or alternative diploma. 

■ Graduation rate. The percentage of 
students who have earned a regular 
diploma. 

■ Completion rate. The percentage of 
students who have earned a regular 
diploma or an alternative (for example, 
GED)." 


Overview of the recommendations 

This practice guide includes four recom¬ 
mendations focused on identifying students 
at risk for dropping out, and addressing the 
challenges they face with both broad and 
individual interventions. Recommendations 

1 and 2 suggest monitoring and intervening 
with different levels of intensity, depend¬ 
ing on student needs. Recommendation 1 is 
preventative and proactive. Recommendation 

2 focuses on serving students with persistent 
challenges who need more intensive support. 
Recommendations 3 and 4 provide guidance 
for helping students connect with their educa¬ 
tion and keeping them engaged in school. 
Each recommendation includes several how¬ 
to steps to help educators implement the 
recommended practices. 

Recommendation 1. Monitor the progress 
of all students, and proactively intervene 
when students show early signs of atten¬ 
dance, behavior, or academic problems. 

■ Step 1: Organize and analyze data to 
identify students who miss school, have 
behavior problems, or are struggling in 
their courses. 

■ Step 2: Intervene with students who show 
early signs of falling offtrack. 

■ Step 3: If data show high rates of absen¬ 
teeism, take steps to help students, 
parents, and school staff understand the 
importance of attending school daily. 

■ Step 4: Monitor progress and adjust inter¬ 
ventions as needed. 

Recommendation 2. Provide intensive, 
individualized support to students who have 
fallen offtrack and face significant challenges 
to success. 

■ Step 1: For each student identified as 
needing individualized support, assign a 
single person to be the student’s primary 
advocate. 
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■ Step 2: Develop a menu of support options 
that advocates can use to help students. 

■ Step 3: Support advocates with ongoing 
professional learning opportunities and 
tools for tracking their work. 

Recommendation 3. Engage students by 
offering curricula and programs that connect 
schoolwork with college and career success 
and that improve students’ capacity to man¬ 
age challenges in and out of school. 

■ Step 1: Directly connect schoolwork to 
students’ options after high school. 

■ Step 2: Provide curricula and programs 
that help students build supportive rela¬ 
tionships and teach students how to man¬ 
age challenges. 

■ Step 3: Regularly assess student engage¬ 
ment to identify areas for improvement, 
and target interventions to students who 
are not meaningfully engaged. 

Recommendation 4. For schools with many 
at-risk students, create small, personalized com¬ 
munities to facilitate monitoring and support. 

■ Step 1: Decide whether the small com¬ 
munities will serve a single grade or 
multiple grades. 

■ Step 2: Create teams of teachers that 
share common groups of students. 

■ Step 3: Identify a theme to help build a 
strong sense of identity and community 
and to improve student engagement. 

■ Step 4: Develop a schedule that provides 
common planning time and ample oppor¬ 
tunities for staff to monitor and support 
students. 

Summary of supporting evidence 

Practices recommended in this guide are 
examined in 25 studies that meet WWC group 
design or pilot regression discontinuity stan¬ 
dards. 12 These studies were identified through 
a thorough literature search and screened 


for relevance according to eligibility criteria 
described in the practice guide protocol. 13 
Studies were classified as having a positive or 
negative effect on student outcomes if the find¬ 
ings were either statistically significant (unlikely 
to occur by chance) or substantively important 
(large enough to be practically significant). 


Study Eligibility Criteria 

For more information, 
see the review protocol. 

Time frame: Published between January 
1987 and January 2016; earlier or later work 
was reviewed if recommended by the panel. 

Location: The United States, its territories, 
or tribal entities; or in Canada. 

Sample requirements: Students currently 
enrolled in secondary schools in grades 
6 - 12 . 


Dropout prevention efforts are often multi¬ 
faceted, and many studies examined inter¬ 
ventions with several components. In these 
programs, some practices are often related to 
multiple recommendations in the guide, while 
other practices might not be recommended 
in the guide. Studies of these interventions 
typically cannot identify whether the effects 
of the intervention are due to one of the 
practices within the intervention or all of the 
practices implemented together. Nearly all the 
studies used to support Recommendations 1 
and 4 examined interventions that included 
components related to other recommenda¬ 
tions or components unrelated to any recom¬ 
mendation. However, Recommendations 2 
and S are each supported by multiple studies 
that provide a direct test of the recommended 
practices, so there is stronger evidence of the 
effectiveness of those practices. 

The studies examined interventions for 
students who were currently enrolled in 
secondary schools (middle and high schools) 
and who were at risk for dropping out or 
attended schools with large numbers of 
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at-risk students. Thirteen studies examined 
interventions delivered to at-risk subgroups 
of students within a school, 14 and one study 
examined an intervention delivered to all 
Latino students within a school. 15 Nine stud¬ 
ies examined interventions delivered to all 
students in a grade or school, regardless of 
individual students’ risk for dropping out. 16 
In these studies, the sample schools serve 
primarily at-risk students. The final two stud¬ 
ies examined alternative schools specifically 
designed for at-risk students. 17 


Levels of Evidence 

For more information, 
see Appendix A. 

The level of evidence assigned to each 
recommendation indicates the strength of 
the evidence for the effect of the practices 
on students staying in, progressing in, and 
graduating from school. 

Strong level of evidence: There is con¬ 
sistent evidence that the practices improve 
student outcomes for a diverse population 
of students. 

Moderate level of evidence: There is 
some evidence that the practices improve 
student outcomes, but there may be ambi¬ 
guity about whether that improvement is 
the direct result of the practices or whether 
the findings can be replicated with a diverse 
population of students. 

Minimal level of evidence: There is at 
least one study that meets WWC group 
design standards and demonstrates that 
the practices improve student outcomes. 
However, the panel cannot point to a body 
of evidence that demonstrates the practices’ 
positive effects. This may be because it has 
not been studied, it is difficult to study with 
a rigorous design, or there is weak or con¬ 
flicting evidence of effectiveness. 


Studies supporting the recommendations 
examined three key categories of outcomes 
(or outcome domains) related to dropout 


prevention: (1) staying in school, (2) pro¬ 
gressing in school, and (3) graduating 
school. The guide describes effects that the 
recommended practices have on all three 
outcome domains, but it highlights effects on 
graduation, when this outcome is reported 
and meets WWC standards. Although educa¬ 
tors and administrators need to understand 
which practices have been shown to both 
keep students in school and eventually 
improve graduation outcomes, high school 
graduation is the central outcome of dropout 
prevention efforts. (For more information 
about outcomes, see Appendix D.) 

Studies showed that practices in all four 
recommendations improved outcomes in 
the staying in school and graduating school 
domains. The studies consistently found that 
the recommended practices had positive 
effects on students’ graduation. Most studies 
examining outcomes in the staying in school 
domain found positive effects, although some 
studies supporting each recommendation 
found indeterminate effects on staying in 
school. All recommendations include a study 
with indeterminate effects on progressing in 
school, though Recommendations 1, 2, and 3 
also include a study with positive effects on 
progressing in school. 

The panel and practice guide staff assigned 
a level of evidence to each recommendation 
based on an assessment of the relevant evi¬ 
dence supporting each recommendation. All 
recommendations must be supported by at 
least a minimal level of evidence to be included 
in the guide; practice guides do not recom¬ 
mend practices with no evidence. The level of 
evidence is assigned to the recommendation, 
and steps and examples within the recommen¬ 
dations are drawn from evidence as well as 
panel expertise. The steps and examples are 
intended to make the recommendations more 
actionable for practitioners, but there is not 
necessarily evidence (that meets WWC design 
standards) directly testing and supporting 
each step and example. Throughout the guide, 
steps and examples supported by evidence 
are indicated by endnotes (citations are bolded 
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for studies that meet WWC design standards). 
Steps and examples without citations were 
developed in conjunction with the panel based 
on their experience and knowledge of the 
related literature. 


Table 1 shows the level-of-evidence rating for 
each recommendation as determined by WWC 
criteria outlined in Table A.1 in Appendix 
A. (Appendix D presents more information 
on the body of evidence supporting each 
recommendation.) 


Table 1. Recommendations and corresponding levels of evidence 



Levels of Evidence 

Recommendation 

Minimal 

Evidence 

Moderate 

Evidence 

Strong 

Evidence 

1. Monitor the progress of all students, and proactively intervene 
when students show early signs of attendance, behavior, or 
academic problems. 

♦ 



2. Provide intensive, individualized support to students who have 
fallen offtrack and face significant challenges to success. 


♦ 


3. Engage students by offering curricula and programs that 
connect schoolwork with college and career success and 
that improve students’ capacity to manage challenges in 
and out of school. 



♦ 

4. For schools with many at-risk students, create small, personal¬ 
ized communities to facilitate monitoring and support. 


♦ 



How to use this guide 

This guide is targeted to school and dis¬ 
trict administrators, as well as members 
of student-support teams including school 
counselors, social workers, psychologists, 
and teachers. It provides recommendations 
that can be implemented in conjunction with 
existing academic curricula and student- 
support services. No single recommendation 
is likely to prevent dropout entirely on its 
own, because each addresses different types 
of student needs and challenges. The panel 
believes that Recommendations 1, 2, and 3 
complement each other and are most effec¬ 
tive when implemented simultaneously in all 
types of schools. Recommendation 4 should 
be implemented primarily in schools with 
high dropout rates to facilitate implementa¬ 
tion of the other three recommendations. It 
is important to note that Recommendation 4 
might be more challenging to implement, as 
it could involve staffing and other structural 
changes in the school. 


While the guide uses specific examples to 
illustrate how the recommendations can 
be implemented, there are a wide range of 
activities that could be used to implement the 
recommended practices. The type of activ¬ 
ity may vary depending on school context, 
grade range, and other support available at 
the school. In addition, activities may vary 
depending on budget limitations. The panel 
did not explicitly consider financial costs of 
implementing the recommendations, but 
some of the recommended practices, such 
as hiring individuals to serve as advocates 
or planning and implementing small learning 
communities, may require expenditures. 18 

Practitioners in after-school or community- 
based programs may also be able to adapt 
some of the recommended practices to 
non-school settings, but the specific activities 
implemented in these types of settings might 
differ from those used during the school day. 
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Professional development providers, research¬ 
ers, and state-level administrators and policy¬ 
makers can also use this guide. Professional 
development providers can use the guide to 
encourage the use of evidence-based prac¬ 
tices or to prompt discussions about dropout 
prevention strategies in professional learning 
communities. Researchers may find oppor¬ 
tunities to test the effectiveness of various 
approaches and explore gaps or variations 
in the dropout prevention literature. State- 
level officials can use the guide to support or 
facilitate the recommended practices within 
districts, schools, and affiliated programs. 

Alignment with the 
previous practice guide 

The 2008 Dropout Prevention: A Practice Guide 19 
had six recommendations, with each recom¬ 
mendation categorized as involving diagnostic 


practices, targeted interventions, or school¬ 
wide interventions. This updated guide 
includes four recommendations that fall 
into the same broad categories as the 2008 
guide’s recommendations, but the updated 
recommendations are based on a more recent 
body of evidence and are aligned with tech¬ 
nologies and practices used in schools today. 
Unlike the 2008 guide, some of the updated 
recommendations include both targeted and 
schoolwide approaches, so that educators 
can offer support to all students while provid¬ 
ing more intensive interventions for those 
who need it. Table 2 shows the relationship 
between this guide’s recommendations and 
those from the previous guide. The left col¬ 
umn lists the recommendations in the current 
practice guide, and the right column lists the 
recommendation from the previous practice 
guide from 2008. The center column explains 
how they overlap. 


Table 2. Relationship between recommendations in dropout prevention practice guides 


Preventing Dropout 
in Secondary Schools 
(2017) 


Recommendation 1. 

Monitor the progress 
of all students, and 
proactively intervene 
when students show 
early signs of atten¬ 
dance, behavior, or 
academic problems. 


Recommendation 2. 

Provide intensive, indi¬ 
vidualized supports 
to students who have 
fallen off track and 
face significant chal¬ 
lenges to success. 


Alignment Between Guides 


Recommendation 1 in the updated guide captures many of the 
ideas addressed in Recommendation 1 in the former guide, but 
expands those ideas to include proactive interventions to help stu¬ 
dents who show early signs of being off track. 

Recognizing that student data systems have improved since the 
former guide, Recommendation 1 in the updated guide provides 
information on specific data schools should use and how to orga¬ 
nize data to identify students showing signs of falling offtrack. 
Recommendation 1 in the updated guide includes a stronger focus 
on attendance, which recent evidence indicates is especially impor¬ 
tant for dropout prevention. 

Embedded in Recommendation 1 in the updated guide are com¬ 
ponents of Recommendation 3 in the former guide: early signs of 
falling off track academically are used to place students in preven¬ 
tative interventions designed to reduce course failure. 


Like Recommendation 2 in the former guide, Recommendation 2 in 
the updated guide involves using adult advocates for more inten¬ 
sive monitoring and personalized interventions. 

The updated Recommendation 2 goes further by encouraging 
schools to support advocates with a menu of strategies to use 
with students, as well as training, mentoring, and data-tracking 
systems. 

The updated Recommendation 2 also improves upon Recommen¬ 
dation 3 in the former guide by providing additional guidance on 
delivering more intensive academic services to students who have 
already failed courses. 


Dropout Prevention: 

A Practice Guide (2008) 


Former Recommendation 1. 

Utilize data systems that sup¬ 
port a realistic diagnosis of the 
number of students who drop 
out and that help identify indi¬ 
vidual students at high risk of 
dropping out. 


Former Recommendation 3. 

Provide academic support and 
enrichment to improve aca¬ 
demic performance. 


Former Recommendation 2. 

Assign adult advocates to stu¬ 
dents at risk of dropping out. 


(continued) 
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Introduction (continued) 



Table 2. Relationship between recommendations in dropout prevention practice guides (continued) 


Preventing Dropout 
in Secondary Schools 
(2017) 

Alignment Between Guides 

Dropout Prevention: 

A Practice Guide (2008) 

Recommendation 3. 

Engage students by 
offering curricula and 
programs that connect 
schoolwork with col¬ 
lege and career suc¬ 
cess and that improve 
students’ capacity to 
manage challenges in 
and out of school. 

■ Recommendation 3 in the updated guide includes components of 
Recommendations 4 and 6 in the former guide. It recommends a 
multifaceted approach to facilitating student engagement in school 
by bringing together the problem-solving and goal-setting activi¬ 
ties in former Recommendation 4 with the college- and career- 
focused activities in former Recommendation 6. 

Former Recommendation 

4. Implement programs to 
improve students’ classroom 
behavior and social skills. 

Former Recommendation 6. 

Provide rigorous and relevant 
instruction to better engage 
students in learning and pro¬ 
vide the skills needed to grad¬ 
uate and to serve them after 
they leave school. 

Recommendation 4. 

For schools with many 
at-risk students, cre¬ 
ate small, personalized 
communities to facili¬ 
tate monitoring and 
support. 

■ Recommendation 4 in the updated guide is related to Recommen¬ 
dation 5 in the former guide. It provides guidance for creating 
personalized learning communities. It expands on the recommen¬ 
dation in the former guide by including steps for strengthening 
the community with a theme, a master schedule, and additional 
teacher planning time. 

Former Recommendation 

5. Personalize the learning 
environment and instructional 
process. 
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Recommendation 1 



Monitor the progress of all students, and proactively 
intervene when students show early signs of 
attendance, behavior, or academic problems. 

Students typically decide to drop oat of high school after an accumulation of setbacks and 
struggles over several years. 20 Three key indicators — (I) attendance, (2) behavior, and (3) 
course performance—are reliable predictors of which students are at risk for dropping out. 2 ’ 
By continually monitoring students’ attendance, behavior, and grades, schools can intervene at 
the first signs of trouble, before students need intensive support to graduate on time. 22 


The panel recommends that schools moni¬ 
tor data for all students and intervene when 
students show signs of being at risk as 
a preventative measure. Schools may be 
inclined to focus their resources on students 
already off track for graduation, but this 
approach can overlook students who are just 
starting to fall offtrack. By monitoring all 
students, schools can intervene proactively, 
reducing the effort and resources needed 
to help students graduate on time, and 
increasing the likelihood these students will 
graduate. 23 Regular monitoring of data also 
enables school staff to address school-level 


issues contributing to dropout rates, such 
as courses with high failure rates, low atten¬ 
dance during particular periods, or suspen¬ 
sion policies that increase absences. 24 

Summary of evidence: Minimal Evidence 

Six studies contributed to the level of evidence 
for this recommendation (see Appendix D for 
more information). 25 Five studies meet WWC 
group design standards without reserva¬ 
tions, which is the highest possible rating for 
group design studies and indicates the high¬ 
est degree of confidence that the observed 


(8) 










Recommendation 1 (continued) 



effects were caused by the interventions. 26 
One study meets WWC group design stan¬ 
dards with reservations, which indicates a 
lower degree of confidence that the observed 
effects were caused by the interventions. 27 
Two studies found that the recommended 
practices improved student outcomes in 
at least one of the three outcome domains 
related to dropout prevention. 28 These two 
studies examined outcomes in the gradu¬ 
ating school domain—which is weighted 
more heavily than other outcome domains 
in determining the level of evidence 29 —and 
found positive effects. 30 However, neither of 

Steps to carry out the recommendation 


the two studies that demonstrated improved 
student outcomes evaluated an intervention 
that included all four steps of the recom¬ 
mendation without any other components, 
so there is no direct test of the full recom¬ 
mendation. In addition, one study that found 
positive effects was conducted in Chicago 
Public Schools and the other in North Carolina, 
limiting generalizability beyond students 
with those demographics. 31 The absence of 
a direct test of the recommendation and the 
limited generalizability of the studies indicate 
a minimal level of evidence. 


1. Organize and analyze data to identify students who miss school, have behavior 
problems, or are struggling in their courses. 


Use data routinely collected in school as a 
starting point for monitoring the three key 
“ABC” early warning indicators: 32 

■ Attendance (total, unexcused, and 
excused) 

■ Behavior (suspensions, office referrals) 

■ Course grades (including intermediate 
outcomes such as failing tests or missing 
assignments) 

These three ABC indicators have consistently 
been shown to be reliable predictors of which 
students are at risk for dropping out. 33 While 
issues such as pregnancy, homelessness, 
problems at home, and bullying at school are 
risk factors, their impact is often captured 
through the three ABC indicators. 

Schools are encouraged to use historical 
student ABC data (i.e., data from previous 
years) to establish benchmarks that indicate 
when their students are at risk for falling off 
track for graduation and need intervention. 
For example, based on attendance patterns, 
it may be that a lower threshold such as 
85% attendance or higher threshold such as 


Students who are off track for gradu¬ 
ation have low attendance rates, behav¬ 
ioral problems, or academic problems 
that put them at risk of dropping out. 


95% attendance may be needed. 34 Similar 
decisions will be needed for establishing 
thresholds for behavior problems and course 
grades. Example 1.1 provides examples of 
early warning indicator thresholds from three 
school districts for identifying students in 
middle school grades who are slipping off 
track and need intervention. Each district 
has a different context and employs a differ¬ 
ent approach to early warning indicators to 
suit its particular needs. Schools can use the 
thresholds in Example 1.1 as a starting point 
for defining their own early warning indicator 
thresholds. 

Note that a less stringent threshold translates 
to identifying more students as being at risk 
and may include students who may not eventu¬ 
ally be at risk for being offtrack. 35 One advan¬ 
tage of the higher threshold, however, is that 
students are identified early on, and less effort 


(9) 









Recommendation 1 (continued) 


EXAMPLE 1.1 


Sample district early warning indicator thresholds for middle school grades 36 



District l 37 

District 2 

District 3 

Attendance 

indicator 

Daily attendance of 90% or less 

Daily attendance 
of 80% or less 

Daily attendance 
of 95% or less 

Behavior 

indicator 

Three or more days of 
suspension 

Repeated behavior 
problems 

NA 38 

Course 

performance 

indicator 

Failure in English, or math, or 
both, and/or a failing average 
for English, math, science, and 
social studies 

Failing English or 
math 

A semester grade 
of D or lower in 
English or math 


and fewer cost-intensive efforts will likely be 
needed. A lower threshold will mean identifying 
fewer students initially. But it could be that by 
the time the student is identified, the problems 
have compounded or have become entrenched, 
and more intensive services are needed. 

Schools can access ABC indicators from their 
school data systems and regularly update 
them as part of everyday operations. There¬ 
fore, school staff need not wait until the end 
of a marking period to discover if a student 
is struggling. Some schools may already 
have access through their state or district to 
an online early warning system, such as 
the one shown in Example 1.2, which pro¬ 
vides built-in reports to help monitor student 
progress. 39 Schools can also create their own 
organizing and monitoring tools using simple 
spreadsheets. Schools can upload data regu¬ 
larly collected in gradebooks and attendance 
systems into a spreadsheet, where they can 
then summarize and sort the data to identify 
which students need additional support. 

Organize the data so that it is easy for staff to 
flag which students are showing early warning 
signs of falling offtrack. To identify individual 
students who are showing early warning signs, 
summarize each student’s current and past 
attendance, behavior, and course performance 
data. The spreadsheet can be formatted so 
that values outside of a specified range are 
automatically highlighted, which can be used 


to identify attendance, behavior, or grades 
that exceed the early warning indicator 
thresholds (Example 1.3). 

Also, examine ABC indicators at the school 
level to identify patterns and trends that might 
be related to dropping out. Create summaries 
of ABC indicators by subject, class, or specific 
groups of students. A sample summary of ABC 
indicators is provided in Example 1.4. This 
type of summary can be used for school-level 
indicators, or to summarize ABC indicators for 
a group of students. For instance, if Example 
1.4 summarized ABC indicators for the first 
period class, school leaders may notice that 
the number of students with more than three 
absences in their first period grew from six in 
September to 20 in October. This could indi¬ 
cate a problem with students arriving at school 
on time. Alternatively, Example 1.4 might 
summarize ABC indicators for a specific group 
of students, such as 9th-grade male students. 
In this case, the increase in absences may be a 
warning that these students are disengaging 
from school. Examining ABC indicators for 
groups of students can save resources com¬ 
pared to individual monitoring, and it can 
allow schools to prioritize specific groups, 
classes, or periods. 

School staff working on dropout issues at 
their schools should meet regularly—as often 
as weekly—to review students’ attendance 
rates, disciplinary referrals, and course 
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EXAMPLE 1.2 


Sample early warning system, and other tools for organizing data 

Early warning system (EWS) online tool: Data can also be organized using an EWS tool. The advantage 
of such a tool is that it allows for multiple users with different access levels to sort and filter data in sophisticated 
ways, generate various reports, and monitor student progress, all using a single platform. 

Example of an EWS tool 


Year 


Grading Period Grade 


Disability Disadvantaged ELL 


Gender 


Race/Ethnicity Risk Incoming 


9 ▼! [ No t| I Yes ▼! | No t| | Male ▼ ] [ White ▼] [ High ▼[ 


Demographics Attendance Status 


Behavior 


Course Performance 


Interventions 


Course Performance 


Student ID 

First name 

Last name 

Grading period 

Course Code 

Course Name 

Course Grade 

123456 

James 

Snipes 

Quarter 3 

ALG1 

Algebra 1 

C 

789101 

Roger 

Palmer 

Quarter 3 

ALG1 

Algebra 1 

D 

111213 

Dante 

Williams 

Quarter 3 

ENG9 

9th grade English 

F 

141516 

Martin 

Taylor 

Quarter 3 

ENG9 

9th grade English 

B 

171819 

Jimmie 

Vaughan 

Quarter 3 

ENG9 

9th grade English 

D 


For additional information on EWS tools or for technical assistance, visit The Early Warning Systems Learning Series website at 
https://ies.ed.gov/ncee/edlabs/projects/ews.asp. 

Spreadsheet software (e.g., Microsoft Excel or Google Sheets): For schools with no student-information 
systems in place (e.g., district early warning system or other electronic platforms for organizing, storing, and 
viewing student data), a good starting point is a spreadsheet. This software allows for inputting and sorting of 
data, which is the first step in uncovering patterns. Schools can also consolidate their electronic gradebook/ 
attendance data using spreadsheet software. 


EXAMPLE 1.3 


Sample template for organizing data at the student level 


Student 

ID 

Last 

name 

First 

name 

Grading 

period 

Current 

absences 

Prior 

period 

absences 

Current 

behavior 

incidents 

Prior 

behavior 

incidents 

Current 

GPA 

Prior 

Ds or 

Fs 

102201 

Robert 

Sarah 

2 

0 

0 

0 

0 

3.1 

— 

104451 

Smith 

Kyla 

2 

0 

0 

0 

0 

2.5 

— 

245230 

Hassan 

Bob 

2 

8 

0 

0 

0 

1.6 

2 

216222 

D'Shay 

Matt 

2 

2 

2 

2 

0 

2.4 

1 
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Recommendation 1 (continued) 


EXAMPLE 1.4 


Sample template for organizing data at the school level 


Absence counts Office referral counts Grade counts 


Month 

0 

1 

2 

3 

>3 

0 

1 

2 

3 

>3 


B 


D 

F 

August 

295 

4 

1 

0 

0 

0 

2 

0 

0 

0 

— 

— 

— 

— 

— 

September 

229 

12 

48 

5 

6 

0 

1 

2 

0 

0 

35 

100 

140 

25 

10 

October 

202 

31 

32 

15 

20 

0 

0 

3 

0 

1 

40 

95 

135 

30 

10 

Total to date 

726 

47 

81 

20 

26 

0 

3 

5 

0 

1 

75 

195 

275 

55 

20 


performance, and to plan interventions for 
students needing support. If a school has a 
small number of students whose data show 
early warning signs of falling offtrack, then 
existing student support teams might take on 
the additional tasks of monitoring the data 
and planning interventions. However, schools 
with large numbers of at-risk students might 
need to create a dedicated team—or teams 
for each grade level—consisting of teachers, 
counselors, and school leaders, to address 
dropout issues in their schools. 40 Additional 
strategies for schools with many at-risk stu¬ 
dents are discussed in Recommendation 4. 

In addition to monitoring students during 
the school year, review ABC indicators from 


the previous school year to identify students 
who may need outreach over the summer or 
additional support at the beginning of the 
school year to prevent them from slipping 
offtrack. Pay particular attention to student 
performance during transition years, such as 
6th grade and 9th grade, to see if there is a 
decline in student performance during those 
years. Students often slip offtrack during 
transition years, even if they previously per¬ 
formed well in school. A schoolwide decline 
in performance during transition years may 
indicate that all 6th- or 9th-grade students 
need additional support, such as a mentoring 
program, additional academic help, or closer 
monitoring of attendance. 41 


2. Intervene with students who show early signs of falling offtrack. 


Use the data collected in Step 1 to identify 
students who are in need of early interven¬ 
tion to ensure they remain on track for 
graduation. Often, the path to dropping out 
starts slowly, with one failed course or a 
few absences. Without early intervention, 
the challenges students face can compound, 
requiring more intensive support (described 
in Recommendation 2). These early inter¬ 
ventions can occur for individual students, 
groups of students, or the entire school. 

Early interventions might be academic in 
nature. For instance, additional academic sup¬ 
port when a student has failed a unit test or 
is not turning in homework assignments may 


improve their performance well before they 
receive their first D or F grade in a course at 
the end of the grading period. For example, 
considerjohn, an llth-grader, who has not 
been turning in his assignments for 2 weeks 
and has failed his weekly test. Ms. Robertson, 
his teacher, checks in with him immediately, 
rather than waiting until the end of the semes¬ 
ter, and realizes that he is having difficulty with 
the subject matter. She offers assistance during 
lunch breaks and refers John to the homework 
club for additional help with assignments. 
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School staff can use gradebook data shortly 
before the end of each marking period to 
identify students whose class averages are 













































Recommendation 1 (continued) 




on the borderline for failure (either high Fs or 
low Ds) for simple and non-intrusive interven¬ 
tions, before their grade is set. For each of 
these students, teams could identify a teacher 
that has good rapport with the student to 
have a one-on-one conversation about how 
they can get their grade up before the end of 
the marking period. 

Other students may need social and emotional 
interventions. For example, consider this early 
intervention that was implemented to help 
Mikela, a 7th-grader, who was sent to the 
office multiple times in the last 2 weeks. Arin, 
the school counselor, spoke to Mikela’s teach¬ 
ers and found out that Mikela was consistently 
disrupting class by talking to her friends and 
yelling at her teachers when she was asked 
to stay on task. Arin spoke to Mikela about 
joining an anger-management group that was 
being offered at school once a week to learn 
ways to react to her teachers more produc¬ 
tively (see Recommendation B for more infor¬ 
mation on social and emotional interventions). 

Before planning any intervention, informally 
check in with students about changes in atten¬ 
dance, behavior, or grades to discover the 
cause of the problem. These types of informal 
probes are quick and not time-consuming, and 
yet allow for gathering of information that will 
help in determining a course of action to keep 
students on track. Discuss whether there are 
any issues (e.g., pregnancy, homelessness, 
problems at home, bullying at school) that are 
affecting the student’s engagement with school. 

These informal checks might reveal, for exam¬ 
ple, that Andrew is missing school because 
the car has broken down and he does not 
have a ride to get to school. In such instances, 


Andrew’s parents might need help in setting 
up a network of supports to rely on for emer¬ 
gencies. School staff should also discuss with 
Andrew and his parents the importance of 
attendance for graduating from high school. 

Based on the data patterns, interventions may 
be needed for a group of students. The data 
might show, for example, several students 
entering high school with Ds and Fs in their 
8th-grade math classes. Given the importance 
of succeeding academically in 9th grade 42 —a 
key transition year—the school could provide 
a double-dose math class for struggling stu¬ 
dents. 43 The additional math class can help 
students grasp the foundational material 
necessary for an upcoming lesson, review dif¬ 
ficult areas a second time, and provide addi¬ 
tional practice problems to reinforce learning. 

It is important to make sure the double-dose 
classes are staffed with experienced teachers 
who have shown success engaging students in 
the past. 44 

The panel recommends also reviewing 
schoolwide data to assess needs for inter¬ 
vention at the school level. For example, if 
data show that high rates of suspension are 
contributing to excessive absences for some 
students, schools may introduce new disci¬ 
plinary policies or behavioral interventions. A 
school might implement a schoolwide alterna¬ 
tive to suspensions, such as positive behavior 
intervention and supports (PBIS), mediation, 
in-school supervision, or restorative pro¬ 
grams. By reducing absences and consequent 
missed instruction time and disengagement 
from school, such alternatives can prevent 
behavior problems from exacerbating the risk 
of students dropping out of school. 45 


3. If data show high rates of absenteeism, take steps to help students, parents, and 
school staff understand the importance of attending school daily. 


Attendance is an especially important indica¬ 
tor of whether students are at risk of drop¬ 
ping out; therefore, the panel recommends 
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that schools pay particular attention to 
attendance rates. When students are chroni¬ 
cally absent (generally defined as 10% of the 







Recommendation 1 (continued) 


school year, which is 18 days out of a typical 
180-day school year), they are likely to fall 
behind in their classwork and disengage as 
lessons make less sense to them or there are 
large numbers of assignments to make up. 46 
The panel believes that it is important to set 
clear expectations for attendance and embed 
it in the school culture. If schoolwide data 
show low attendance rates for many students, 
initiate programs that reach all students, staff, 
and parents to emphasize the importance of 
attendance for graduation. 

For instance, the data might show that many 
students in a high school are not attending 
first period classes. In response, school staff 
and families could work together to develop 
strategies for getting students to school on 


time, such as emergency carpools or wake-up 
phone reminders. To address high absenteeism 
rates more broadly, the school principal might 
hold several parent-student nights to commu¬ 
nicate the importance of attending school and 
its relationship with doing well academically. 
The principal can share an infographic similar 
to the one shown in Example 1.5 and discuss 
with parents and students the relationship 
between attendance, grades, and graduation 
in middle and high school. 47 At the meeting, 
the principal can also distribute “fridge stickers,” 
as shown in Example 1.6, to highlight the 
attendance rates and grades needed to gradu¬ 
ate from high school and attend college. The 
panel believes that these types of graphical 
displays are effective ways to communicate 
expectations to students and parents. 


EXAMPLE 1.5 


Sample infographic highlighting the importance of attendance and grades for graduation 48 



EXAMPLE 1.6 


Sample “fridge sticker” highlighting the grades and attendance needed to prepare for college 


What do I need to do 
to prepare for college? 


In middle school, I should aim for a GPA of 3.0 
or higher and not be absent for more than 9 days 
to prepare for college. 

In high school, I should aim to earn Bs or higher 
and be absent less than 5 days to prepare for 
college. 


,49 



S' 
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Recommendation 1 (continued) 


Parents, students, and even school staff 
may not realize that being absent a day 
or two periodically can add up to chronic 


absenteeism. Use visuals such as Example 
1.7 to show how absences add up across a 
school year. 


EXAMPLE 1.7 


Sample visual showing how absences can add up to chronic absenteeism during a school year 50 
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Train all school personnel—teachers, admin¬ 
istrative and support staff, counselors, and 
coaches—on the importance of attending 
every day. Hold information sessions for 
the entire school community at the start of 
each school year to discuss what constitutes 
chronic absenteeism. Remind school staff that 
it is difficult to create a culture where atten¬ 
dance matters if teachers and school staff 
themselves are absent frequently. 


Throughout the school year, post visuals 
highlighting expectations for attendance in 
highly visible places. These help reinforce the 
school culture and message that attending 
school daily is important. For example, create 
a banner like the one shown in Example 1.8 
describing attendance performance levels, as 
a simple way to communicate the goals and 
expectations for attendance. 


EXAMPLE 1.8 


Sample banner on attendance performance levels 51 



( 15 ) 






































































































































Recommendation 1 (continued) 


To make attendance an integral part of school 
culture, schools can incentivize, recognize, and 
reward not only students, but also parents and 
teachers. Provide incentives to students and 
parents for attending school and for attend¬ 
ing on time, as tardiness impacts learning as 


well. Have inter-class competitions for best 
attendance or most improved attendance on 
a weekly basis, and reward both teachers and 
students for their efforts. See Example 1.9 
for ideas for incentivizing, recognizing and 
rewarding parents, teachers, and students. 


EXAMPLE 1.9 


Strategies for incentivizing, recognizing, and rewarding students, parents, and teachers 
in middle and high schools 

Caught-you: Recognize students daily at random times during the day for being at school 
and/or being on time. Offer incentives such as homework passes, front-of-the-lunch-line 
passes, and special recognition from teachers and the principal. 

Raffles: Have raffles on days with poor attendance (e.g., Mondays, Fridays, before and after 
holidays). Students only participate in the raffle if they are present the day of the drawing. 

Special events: Plan special events the day before or returning from vacation. 

Parking: Designate a parking space near the building for the student/teacher with the most 
improved attendance 

Over the PA: Announce over the PA the classrooms with perfect attendance for that day. 

Post a picture: Post a picture of the classroom(s) with the highest monthly attendance rate. 

Traveling trophy: The class with the highest attendance keeps the Highest Attendance Trophy. 

Class party: Have a class pizza party or movie/popcorn event as a reward for improved 
attendance. 

Certificates of Recognition: During school assemblies, provide students, teachers, and 
parents with a Certificate of Recognition acknowledging their efforts at attendance. 

Special rewards: During school assemblies, reward students and teachers for the best record 
or most improved record. Reward parents for sending their student to school on time or for 
meeting their student’s personal improvement goal, using donations from local businesses 
(e.g., movie tickets, gift card to a supply store or local restaurant). 

Positive messaging: Make phone calls and/or send positive notes to the parents of students 
whose attendance has improved. 


4. Monitor progress and adjust interventions as needed. 


Regularly monitor the effectiveness of inter¬ 
ventions by reviewing the data on target stu¬ 
dents’ attendance, behaviors, and academic 
progress during team meetings. The interval 
for monitoring will vary depending on the 
student, the problem, and the intervention. In 
the case of a double-dose algebra class, for 


example, it may be sufficient to monitor on a 
quarterly or semester basis. However, a stu¬ 
dent who has been absent several days each 
month can be monitored daily or weekly for 
changes in attendance. Pay particular atten¬ 
tion to students’ performance on indicators 
that the intervention is expected to influence. 
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Recommendation 1 (continued) 



Double-dose algebra, for example, would 
likely influence math grades, while daily 
wake-up calls would influence attendance 
during the first period. 52 Similarly, schools 
can monitor the impact of schoolwide inter¬ 
ventions, such as attendance incentives, by 
reviewing school-level data at team meetings. 

If no improvement is evident based on the 
data, determine whether an alternate course 
of action is necessary. Ascertain whether 
the intervention is being implemented as 
intended and if not, what can be done 
to facilitate better implementation. For 


example, some interventions may not be 
implemented as intended because students 
are not following through with their com¬ 
mitments, or parents are not able to provide 
sufficient support. In such instances, provide 
additional support to ensure that the student 
receives the intervention, as described in 
Example 1.10. In some instances, the inter¬ 
vention may not be working and an alternate 
intervention may be needed. 53 Students 
who continue to not show improvement 
may need more intensive intervention, as 
described in Recommendation 2. 


EXAMPLE 1.10 


Example of providing additional supports for a student 

Consider Mikela, the 7th-grader who was sent to the office multiple times in a 2-week span for 
behavior issues (discussed earlier in Step 2). Noticing the problem, the school counselor, Arin, 
arranged for Mikela to attend the anger-management group at the school. Mikela, however, 
chose not to attend the group regularly. She also started to skip class. To hold Mikela account¬ 
able for her attendance, Arin gave Mikela a signature form for each of her teachers to sign when 
she attended her classes. He asked Mikela to get the anger-management group leader to sign the 
form as well. 

A week later, when Arin checked Mikela’s signature form, he noticed that Mikela had gotten very 
few signatures on her form. He realized that Mikela’s attendance and behavior issues were not 
improving. He was worried they were going to start impacting her academic performance, caus¬ 
ing Mikela to further disengage from school. He decided to try another approach before recom¬ 
mending her for a more intensive intervention (see Recommendation 2). Arin assigned Mikela a 
buddy, an older student who would walk with Mikela to her classes and attend the anger-man¬ 
agement group with her. 

Every week for the next 3 weeks, Arin asked Mikela for her signature forms. Unfortunately, week 
after week, though Mikela received more signatures, her teachers reported that her behavior 
was not improving. Mikela was not responding to the monitoring and intervention Arin was 
providing. Arin decided it was time to assign her an adult advocate who could identify what 
was going on and coordinate more targeted and intense supports to help her stay on track for 
graduation (see Recommendation 2). 
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Recommendation 1 (continued) 


Potential obstacles to implementing Recommendation 1 and the panel’s advice 


Obstacle 1.1. We often do not know about 
course failure until the end of the grading 
period, when it is too late to do anything. 

Panel’s advice. In some schools, the data 
may not be collected centrally, and reports 
may not be generated until the end of the 
semester. In these schools, one option is to 
use real-time data directly from teachers’ 
attendance and gradebooks. When teachers 
and other staff meet to discuss the data, they 
can make decisions by sharing their real-time 
data about student grades and attendance 
during the meetings. This will facilitate more 
timely monitoring and intervention. 

Obstacle 1.2. We already address academic- 
performance problems through retention and 
credit recovery, so additional interventions 
are not needed. 

Panel’s advice. The panel firmly believes 
that it is better to intervene and engage 
students before they fail courses, because 
students are far more likely to stay on track 
and graduate if they pass courses, rather 
than taking credit-recovery courses. This is 
especially true when credit-recovery courses 
are offered online, as these courses may not 
provide students with the personal support 
and flexibility needed to understand the 
complex material with which they originally 
had difficulty. 54 

The panel recommends that schools treat 
retention and credit recovery as a last resort 
for students who are academically behind. 
Instead, intervene earlier, when students 
begin to miss coursework or receive their 
first D or F in a class. Provide tutoring, home¬ 
work help, or other academic support. This 
approach may also save resources by replac¬ 
ing retention and credit-recovery courses, 
which are more expensive, with lower-cost 
interventions such as peer tutoring. 


Obstacle 1.3. Only our school administrator 
has access to the data reports and dashboards 
of our district early warning system. 

Panel’s advice. Staff working on dropout 
issues in the school should be given access to 
individual student data on the ABC indicators 
(attendance, behavior, and course grades). At 
times, depending on the case, some of the 
staff may need access to other data perti¬ 
nent to the situation. Note that data that is 
sensitive in nature cannot be shared with all 
staff in order to protect students’ privacy. 
Federal laws, such as the Family Educational 
Rights and Privacy Act (FERPA) and the FHealth 
Insurance Portability and Accountability Act 
(FIIPAA), govern access to and disclosure of 
data that can identify individual students. 

Most data systems allow for different levels 
of access that comply with federal, state, and 
local laws and can be used to control what 
data are accessible to each staff member. If 
your system does not have a way to control 
access, request information from the district 
on which staff members can have access to 
the data reports. If all staff members work¬ 
ing with these students cannot have access, 
create a report that excludes sensitive data or 
aggregates them across multiple students to 
share with the staff. Those who have access 
to the restricted data should be told that it 
is one of their job responsibilities to prepare 
data reports to share with other school staff, 
and there should be a process in place for 
them to prepare and distribute the reports. 

Obstacle. 1.4. Our staff do not have time 
during their regular work day for meeting with 
their colleagues to address dropout issues. 

Panel’s advice. School staff have busy 
schedules and may not have time to devote 
to working with their colleagues on dropout 
issues, even if they value these meetings. 55 In 
addition, employment contracts may limit or 
prohibit using non-work time, such as time 
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Recommendation 1 (continued) 



before or after school, for meetings. How¬ 
ever, meetings to address dropout issues are 
essential if schools are to effectively use early 
warning systems to identify and intervene 
with at-risk students. Schools can organize 
staff schedules so there is dedicated time 
for them to collaborate and discuss at-risk 
students. For example, grade-level teams that 
meet regularly could schedule time during 
each meeting to share information about 
at-risk students and discuss how to work with 
them. Minimize the amount of work needed 
for meetings by leveraging resources like 
data coaches from the school district or state 
education agency, or staff from community 
organizations like Big Brothers/Big Sisters. 
These outside resources can put together 
early warning reports before meetings, facili¬ 
tate meetings, and identify potential interven¬ 
tions . 56 If there is not enough time to discuss 
all students during meetings, assign staff to 
review data on specific students before the 
meeting and use the meeting time to debrief 
recommended interventions. During busy 
periods, staff can occasionally substitute an 
in-person meeting with a virtual meeting in 


which staff provide input on specific students 
electronically at their convenience during the 
school day rather than meeting as a group. 

Obstacle 1.5. When we try to look at stu¬ 
dents’ grades, we find that some teachers 
don’t enter their grades in the electronic 
gradebook in a timely manner. 

Panel’s advice. Regularly discussing students’ 
grades with teachers provides an incentive for 
teachers to keep their grades up to date. In 
addition, the team or school administrator can 
set specific dates throughout the term when all 
grades need to be “caught up,” rather than just 
once in the middle and once at the end. Regu¬ 
larly remind teachers that if they do not know 
which of their students are failing, then their 
students don’t know it, either. 

Students without complete grade records 
should be included on the list of at-risk stu¬ 
dents, and staff should discuss their perfor¬ 
mance with their teacher so that teachers 
without complete records realize that their 
students might be at risk. 
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Recommendation 2 



Provide intensive, individualized support to students 
who have fallen off track and face significant challenges 
to success. 

Students who are already off track, who have not responded to interventions from 
Recommendation i, or who mast overcome large personal obstacles are unlikely to graduate 
without more intense intervention (see Example 2.1 ). 57 Regularly monitoring ABC data 
(described in Recommendation I) will help staff identify which students are chronically absent 
or have failed multiple courses, which students are not responding to interventions, and which 
are facing significant personal challenges. 

A trained adult advocate can help these stu¬ 
dents by providing individualized support to 
meet their academic, personal, and emotional 
needs. An advocate is a student’s “go-to person” 
for the resources and support needed to grad¬ 
uate, and typically provides these supports 
for the entire time a student is enrolled in the 
school, or, at a minimum, for a full school year. 

Advocates can be school staff or not employed 
by the school district. Advocates can identify 
unmet needs and provide or coordinate more 
intense, individualized support to help stu¬ 
dents get back on track for graduation. 


Summary of evidence: Moderate 
Evidence 

Eight studies contributed to the level of evidence 
for this recommendation (see Appendix D 
for more information ). 58 All eight studies 
meet WWC group design standards without 
reservations, which is the highest possible 
rating for group design studies and indicates 
the highest degree of confidence that the 
observed effects were caused by the interven¬ 
tions. Four studies found that recommended 
practices improved student outcomes in 
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Recommendation 2 


EXAMPLE 2.1 


ill 


Three types of students who may need individualized supports 

1. Students who are off track 

• For example, students who 

■ are chronically absent (less than 90% attendance), or 

■ earned Ds or Fs in core courses (middle school) or credit-bearing courses (high school), or 

■ have frequent behavioral incidents. 

2. Students who failed to respond to Recommendation 1 

• Students are not responding to the monitoring and interventions ^ 

offered in Recommendation 1. 

3. Students who face multiple or acute personal obstacles to overcome 

• For example, students face sudden homelessness, trauma, or pregnancy. 



at least one of the three outcome domains 
related to dropout prevention , 59 and two of 
the three studies that examined outcomes 
in the graduating school domain found posi¬ 
tive effects on high school graduation . 60 
Two of the four studies provide direct tests 
of the recommendation, evaluating interven¬ 
tions that are closely aligned with all of the 

Steps to carry out the recommendation 


1. For each student identified as needing 
to be the student’s primary advocate. 

Provide each high-risk, high-needs student 
with an adult advocate whose primary task is 
to help students get back on track for gradu¬ 
ation. The advocate is the “go-to person” for 
the student in the school or, as one student 
noted, “the person who stays on my back 
about coming to school .” 62 Advocates provide 
students and their families with a trusted 
connection within the school and can act as 
a liaison among students, their families, and 
school staff. 

The advocate should build a strong relation¬ 
ship with the students by communicating 
regularly with them and their families, provid¬ 
ing additional support, and monitoring their 
progress . 63 These strong relationships are 


recommendation’s steps and do not include 
components of other recommendations . 61 
The study samples include at-risk students 
in both middle and high schools across the 
United States. The strong internal validity and 
generalizability, as well as the preponderance 
of positive effects, indicate a moderate level 
of evidence. 


individualized support, assign a single person 


likely to help students feel more connected 
to the school. If possible, the advocate should 
remain connected to the student through 
graduation and stay in touch year-round 
to maintain a relationship with the student 
and the student’s family. Staying connected 
during the school breaks allows advocates 
to help students stay on track for graduation 
by guiding them toward summer school and 
helping them find summer employment or 
avenues for summer youth activities . 64 The 
panel realizes that supporting advocates over 
the summer can be difficult, but encourages 
schools to do so, especially as time required 
for supporting students during summer is 
likely to be less than the time required during 
the school year. 
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Recommendation 2 (continued) 


When students have multiple or acute needs, 
the advocate may also take on the additional 
role of a case manager. As a case manager, 
the advocate coordinates support from mul¬ 
tiple sources to address needs he or she can¬ 
not handle singlehandedly (see Example 2.2). 
For example, the advocate might refer the 
student to professional counseling for anger 
management or connect the student with an 
after-school tutoring program. 


Sometimes, because of his or her own work¬ 
load, an advocate may not be able to take on 
the added role of a case manager. In that situ¬ 
ation, another staff member may take on that 
role but would need to coordinate efforts with 
the advocate. Along with the advocate, case 
managers can develop individual case plans 
for students with more intense needs and 
connect students with community resources 
aligned with their case plan. Case managers 
also provide direct services, such as leading 
discussion groups on conflict resolution. 65 


EXAMPLE 2.2 


Suggested responsibilities for advocates and case managers 


Advocate 66 


• Build a strong relationship 

with the student 

• Develop individualized student 
success plans for each student 


Case Manager 67 



Link students to appropriate resources 

in the school and community 

Coordinate services from the school and 
community 


• Monitor the student’s attendance, 
behavior, and academic progress regularly 

• Build a connection between students, 
families, and school personnel 

• Act as the “go-to person” at school 
for the student 


Provide counseling for specific needs or 
refer the student to a counselor in the school 
or community ^ ^ 



To facilitate building strong personal relation¬ 
ships with each student and to provide suffi¬ 
cient time for monitoring, assign a reasonable 
number of students to each advocate. The 
number of students assigned to a full-time 
advocate or case manager will depend on the 
needs of the students and the other resources 
available in the school and in the commu¬ 
nity. The panel suggests that advocates who 
have students with acute or multiple needs 
should have no more than 20 students as a 
full-time caseload. 68 However, for advocates 
whose caseloads include students with fewer 
demands, or for advocates who function 
more as case managers sharing their respon¬ 
sibilities with others in the school community, 
it may be possible to take on as many as 
50 69 or 100 70 students. It is also important 


to ensure that advocates are not given other 
responsibilities (e.g., covering classes when 
a teacher is absent) that take away time from 
these students. 71 

Choose advocates who have the time and 
energy to devote to the student’s personal and 
academic success, are able to communicate 
effectively with school staff and families, and 
who accept students as they are and believe in 
their ability to succeed. 72 To work effectively 
with students, advocates may need to respond 
to students within 24 hours, conduct home 
visits, and be accessible to students during 
non-business hours, including weekends and 
evenings. 73 Note that while existing school 
personnel (e.g., counselors, teachers) can 
function as advocates, their regular duties 
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Recommendation 2 (continued) 


may not leave them with enough time to 
connect with multiple students, monitor their 
progress, and remain available during non¬ 
work hours, so they may be limited to work¬ 
ing only with one or two students. 

When existing staff cannot fill the roles of 
advocate or case manager, schools can hire 
external individuals from the community who 
have the necessary characteristics and quali¬ 
fications for these roles. Advocates who are 
not employed by the school may have more 
flexible schedules, allowing them to devote 


adequate time to the role. For example, advo¬ 
cates who are not employed by the school 
district may find it easier to continue support¬ 
ing students during the summer because their 
work time is not tied to the school calendar. If 
resources are not available to hire staff or to 
expand the responsibilities of existing staff, 
train community volunteers (such as graduate 
students from local colleges or AmeriCorps 
volunteers) to serve as advocates. Advocates 
can come from a variety of backgrounds, but 
should have the key qualifications described 
in Example 2.3. 74 


EXAMPLE 2.3 


Key qualifications of an advocate 75 

• Avocacy and communication skills, such as the ability to negotiate, 
compromise, and confront conflict constructively 

• Familiarity with the schools and community resources 

• A belief that all students have abilities 

• Willingness to work cooperatively with families and school staff 



When assigning advocates to students, try 
to assign advocates who are from the same 
community, have similar interests, or share 
similar cultural or language backgrounds. 76 
Advocates from the same community 
will find it easier to relate to students and 


communicate with their parents. They will 
also be familiar with available community 
resources. For example, Spanish speakers 
may be assigned to Spanish-speaking indi¬ 
viduals who can serve as an intermediary 
between the school and the family. 


2. Develop a menu of support options that advocates can use to help students. 


Create a menu of available services in and 
around the school community. The panel 
recommends that support options include 
academic-assistance services, behavioral 
interventions, mentoring, sources to address 
basic needs (e.g., provision of food and 
school supplies), college planning and prepa¬ 
ration, rewards for improved behavior, and 
support for families. See Example 2.4 for a 
sample support menu. Schools can customize 
the sample support menu based on specific 
programs and interventions they want to 
provide for their students and their families. 


Flave advocates monitor students’ atten¬ 
dance, behavior, and course performance 
regularly—as often as daily, if necessary—to 
determine whether students need additional 
support and which supports to provide. 77 See 
Example 2.5 for a sample monitoring sheet 
used to track students’ attendance, behavior, 
and grades on a daily basis. The sheet also 
includes space to track the advocate’s inter¬ 
ventions with a student. 
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Recommendation 2 (continued) 


EXAMPLE 2.4 


Sample support menu to address student and family needs 78 

STUDENT SUPPORT 

FAMILY SUPPORT 

Student attendance 

Student 

behavior 

Student academic 
performance 

Provide attendance 
cards for each teacher 
to sign when students 
attend class 

Provide social and 
emotional skills 
training 

Implement individual 
performance contract 
with student and parent 

Provide training on how parents 
can actively engage with their 
child’s school 

Escort students from 
class to class 

Provide individ¬ 
ual counseling 
sessions 

Provide one-on-one sup¬ 
port with a reading or 
math specialist 

Provide tips for monitoring ado¬ 
lescents’ behavior and academic 
performance 

Provide wake-up calls 
to students 

Implement daily 
behavior contract 

Provide after-school 
homework help 

Provide training in accessing 
community resources and con¬ 
tacting school personnel 

Organize transporta¬ 
tion to school 

Provide peer 
mentoring 

Follow-up daily on 
missed assignments 

Provide help with getting wel¬ 
fare benefits or food stamps 


EXAMPLE 2.5 


Sample monitoring sheet for student tracking 79 


Student Monitoring Sheet 

High risk for 

Month 


Student 

ID 

M< 



School 

>nitor 



M 

Tu 

W 

Th 

F 

M 

Tu 

W 

Th 

F 

M 

Tu 

W 

Th 

F 

M 

Tu 

W 

Th 

F 

M 

Tu 

W 

Th 

F 

Check 

Tardy 



























Skip 




























Absent 




























Behavior referral 




























Detention 




























In-school suspension 




























Out-of-school suspension 




























Failing classes/Behind in credits 

D’s F’s Classes passed nut of total Credits earned nut nf total 






























Connect 

BASIC 



























Shared general information 



























Provided regular feedback 



























Discussed staying in school 



























Problem-solved about risk 






















































INTENSIVE 



























Arranged for alternative to 
suspension 



























Contracted for behavior or grades 



























Communicated with parents 



























Made special accommodations 



























Participated in community service 



























Participated in school-sponsored 
activity 



























Participated in social skills group 



























Worked with tutor or mentor 



























Other: 
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Recommendation 2 (continued) 




There is no single approach that will work for 
every student. Advocates can use the support 
menu to create an individualized plan based 
on each student’s needs. Some students are 
likely to need intensive counseling or one-on- 
one mentoring to address severe problems, 
while small-group interventions may suffice 
for others. For example, some students may 
need basic interventions, including feedback 
on their academic progress, discussion on the 
importance of staying in school, and problem¬ 
solving strategies. Others may need more 
intensive interventions, such as social-skills 
groups, parent problem-solving sessions, 


individualized academic contracts, and help 
connecting with after-school activities. 80 

Schools can use resources from the What 
Works Clearinghouse to identify attendance, 
behavioral, and academic interventions with 
evidence of effectiveness. A school looking 
for interventions to improve students’ literacy 
skills, for example, can search for literacy 
interventions with evidence of positive results 
with similar student populations, such as Eng¬ 
lish language learners, or positive results for a 
specific skill, like reading comprehension. 


3. Support advocates with ongoing professional learning opportunities and tools for 
tracking their work. 


The panel believes that an important step in 
offering intensive, individualized support for 
students is to provide ongoing professional 
support for the advocates who serve them. 
Advocates need proper training, ongoing 
feedback and mentoring, opportunities to 
share experiences with colleagues, and 
a system for tracking their work. All new 
hires need training that incorporates how 
and when to use electronic data systems or 
paper forms for monitoring and tracking, 
how to identify student needs and choose 
services within and outside of the school 
that will meet those needs, and how to be 
culturally sensitive. Learning how to build 
relationships with students who are strug¬ 
gling in many aspects of their lives, however, 
is best learned on the job by observing and 
shadowing experienced staff. 

Pair new advocates with more experienced 
staff for mentoring. In addition to intentional 
pairing for peer-learning, allocate sufficient 
time for advocates to have regular meet¬ 
ings with a mentor and fellow advocates to 
review students’ progress, reassess needs, 
and brainstorm ideas (see Example 2.6). If 
case management is done by a separate 
staff person, have the case manager join 
advocates in regular meetings to understand 


the advocates’ process for monitoring and 
supporting students. 

Provide advocates with access to a monitor¬ 
ing system that will help them keep track 
of student intervention plans, log contacts 
with students, monitor student progress, and 
reassess student needs based on progress. 
Monitoring systems can be extensions of the 
data systems used in Recommendation 1 
for gathering and organizing the data (i.e., 
spreadsheets, student information systems, 
or EWS). See Example 2.7 for a sample moni¬ 
toring log. Note that advocates must also 
have access to student data that is relevant 
to the problem (e.g., attendance data, if 
attendance is an issue) to monitor and assess 
progress in real time. If case management is 
provided by a separate staff person, pro¬ 
vide the case manager with information on 
students’ progress on indicators relevant to 
the community resources they are receiving. 
This can help the case manager determine 
if programs are effective and if a student 
needs to be connected with a different com¬ 
munity resource. Supervisors and school 
leaders should periodically review advocates’ 
monitoring sheets, like the one shown in 
Example 2.5, and attendance records to 
verify that they are providing sufficient 
services to students. 81 
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Recommendation 2 (continued) 


EXAMPLE 2.6 


Example of supporting a new advocate 

Juan is a new advocate. To start, he was assigned five students with multiple intense and complex 
needs. Before meeting with his students for the first time, he shadowed his mentor, Vanessa, for 2 
weeks. He watched as Vanessa worked with her students throughout the school day, scheduled ser¬ 
vices (in and out of school as needed) for her students, and discussed her students’ needs and their 
progress with their teachers. 

Juan listened as Vanessa and her student Ryan talked about how hard it is to go to school and con¬ 
centrate on learning when his dad is sick. Vanessa validated Ryan’s feelings and reminded him that 
she was here to help. She talked about how both she and his dad were hoping he would finish high 
school, because it is such an important step for his life. Juan listened as Vanessa arranged for a fam¬ 
ily member to drive Ryan to school each day and for a local charity to bring his family dinner on 
those evenings when his mom works late. 

Once Juan began working with his students, he continued to meet with his mentor every week to 
discuss each student, how he planned to respond to their needs, and any issues that had developed 
since their last meeting. These meetings continued for the next 3 months. Gradually, the meetings 
tapered off, and Juan was assigned more students, until he had a final caseload of 20 students with 
intense needs. 

After the weekly meetings tapered off, Vanessa reviewed Juan’s logs every quarter to determine how 
well he was doing in improving his students’ attendance, achievement, and behavior. Vanessa used 
these periodic reviews to provide Juan with ideas for improving his efforts to support his students. 


EXAMPLE 2.7 


Example of a mentor’s monitoring log 



Student 

name 

Intervention 

Type 

(attendance, 

academic, 

behavior) 

Start 

date 

End 

date 

Mentor 

Contact 

Monitoring log/ 
comments 

John Smith 

study hall for 
Algebra 1 

academic 

9/19/16 


MJ 

weekly 

once 

9/26/16. John attended study 
hall M-F. 

10/3/16. John attended study 
hall M-F. He said it is helping 
him. Mr. Stone said he passed 
weekly test. 

John Smith 

attendance 

checks 

attendance 

9/16/16 


MJ 

weekly 

once 

9/26/16. John did not get 
signatures from all his teachers. 
10/3/16. John did not get 
signatures from all his teachers. 
We will need to walk him to 
class daily. 

Jose Gonzales 

breakout 

session 

conflict 

resolution 

behavior 

9/6/16 


MJ 

daily 

9/26/16. Have been meeting 

Jose daily. He has not received 
office referrals for disturbance 
for two weeks. Starting next 
week, 1 will reduce contact to 
twice a week. 

10/3/16. Have been meeting 

Jose daily. He had 1 office 
referral this week. Will continue 
daily contact. 
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Recommendation 2 (continued) 




Potential obstacles to implementing Recommendation 2 and the panel’s advice 


Obstacle 2.1. My students with special needs 
already have case managers. Providing them 
with an advocate will duplicate work and 
cause confusion. 

Panel’s advice. The roles and responsibili¬ 
ties of a special education case manager 
are limited to ensuring that students with 
special needs are on track to meet the goals 
listed in their Individualized Education Pro¬ 
gram (IEP) or to dealing with administrative 
issues relating to the provision of special 
education services. They do not typically 
address other student needs or problems 
(e.g., being homeless or engaging in gang- 
related activities) or coordinate services such 
as counseling to help students stay on track 
for graduation. To avoid confusion about 
roles and responsibilities, clearly define and 
explain the role of the advocate or case 
manager to the school staff. 

Obstacle 2.2. My school doesn’t have funds 
to pay for advocates and engage in this type 
of close monitoring. 

Panel’s advice. Consider applying for local 
or state ESSA funds (e.g., Title I, Part H funds). 
Schools can also partner with other schools to 
share mentors or work with local or national 
organizations, such as local colleges, Ameri- 
Corps, or Big Brothers/Big Sisters to provide 
volunteer adult advocates. Another option 
is to hire additional staff only for students 
with the most complex cases. Ideally, after 
the provision of monitoring and preventative 
intervention from Recommendation 1, the 
number of students who need a case man¬ 
ager or advocate would be limited. 82 


Obstacle 2.3. \Ne hired advocates from 
outside the school, and they are experiencing 
resistance from other staff and are having 
difficulty accessing student data due to confi¬ 
dentiality concerns. 

Panel’s advice. School administrative sup¬ 
port is critical for ensuring the acceptance 
of hired advocates and case managers. 83 
Rapport and trust with school staff take time 
to build, but having support from school 
administrators and clear delineation of roles 
will help pave the way for the integration of 
hired advocates. Administrators can facili¬ 
tate integration by having advocates attend 
weekly or biweekly staff meetings and partici¬ 
pate in periodic staff-development sessions. 84 
Administrators can also share with teachers 
how important advocates are and how com¬ 
municating with advocates (via text, call, 
or email) will help them be more effective. 
Administrators can create resource maps to 
clarify the staff roles and the services in the 
school to help inform school staff. 85 It may 
help to align advocates with school priorities 
to identify how the advocates address the 
school’s unique needs, fit the school context, 
and are accountable for their work. 86 

Data systems that allow different levels of 
access are particularly helpful in address¬ 
ing privacy and confidentiality concerns. 

Hired advocates can be given access to only 
information that is relevant and necessary 
for addressing their students’ needs. For 
example, knowing that a student is homeless 
is relevant to addressing his or her school 
absences, while other personal information 
such as a history of past abuse may not be. 
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Recommendation 3 





Engage students by offering curricula and programs 
that connect schoolwork with college and career 
success and that improve students’ capacity to manage 
challenges in and out of school. 

Students are engaged in school when they are interested in their classes and see them as 
important to their future, and when they feel they belong in school. Engaged students have 
good attendance, come to class prepared, and are able to navigate daily challenges in 
and out of school. 87 These behaviors, in turn, improve course pass rates and help students 
establish positive relationships with teachers and peers, reinforcing students’ sense of 
belonging in school. 88 


Students may become disengaged from school 
for many reasons, including failing to see 
why school matters, believing they are not 
capable of succeeding in school, and feeling 
that school is a hostile, unsafe place. 89 Student 
engagement encompasses strong relation¬ 
ships among students, teachers, families, and 
schools. Facilitating these relationships can 
involve behavioral, emotional, and cognitive 
components. 90 Programs and curricula tar¬ 
geted at increasing the relevance of school, 
building supportive relationships, and helping 


students manage challenges can help pre¬ 
vent disengagement. This recommendation 
includes multiple strategies educators can use 
to engage students, drawing on evidence sup¬ 
porting either college and career engagement 
or social and emotional learning. The panel 
recommends implementing this recommenda¬ 
tion both as a proactive, schoolwide approach 
to prevent disengagement and as an interven¬ 
tion for students already showing signs of low 
engagement in school. 
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Recommendation 3 (continued) 



Summary of evidence: Strong Evidence 

Fourteen studies contributed to the level 
of evidence for this recommendation (see 
Appendix D for more information). 91 Eleven 
studies meet WWC group design standards 
without reservations, which is the highest 
possible rating for group design studies and 
indicates the highest degree of confidence 
that the observed effects were caused by 
the interventions. 92 Three studies meet WWC 
group design standards with reservations, 
which indicates a lower degree of confidence 
that the observed effects were caused by the 
interventions. 93 Nine studies found that the 
recommended practices improved student 
outcomes in at least one of the three outcome 

Steps to carry out the recommendation 


1. Directly connect schoolwork to students’ 

Make classes relevant by offering curricula 
and academic programs that are clearly con¬ 
nected to a career pathway or postsecondary 
education. These types of programs engage 
students by providing a path from school to 
life after high school. Schools with a college 
or career theme also provide a common focus 
for teachers and students, making it easier 
for teachers to collaborate, share information 
about student progress, and create a coher¬ 
ent schoolwide curriculum. 97 Examples 3.1 
and 3.2 outline the key elements of effective 
college- and career-focused programs, and 
provide examples of how these elements 
might look in practice. 98 

Use the connection between coursework and 
the school’s college or career program as a 
“hook” to engage students in their academic 
classes. Integrating career education and 
college-focused lessons into core academic 
classes is one strategy for helping students 
see how work in academic classes matters 
for life after high school. 


domains related to dropout prevention, 94 
and six of the seven studies that examined 
outcomes in graduating school found positive 
effects on high school graduation. 95 Four of 
the nine studies that found positive results 
provide direct tests of the recommendation, 
evaluating interventions that are closely 
aligned with all of the recommendation’s 
steps and do not include components of other 
recommendations. 96 The study findings are 
collectively generalizable across different 
students and settings. The consistently posi¬ 
tive effects on outcomes, strong internal and 
external validity, and repeated direct tests of 
the recommended practices indicate a strong 
level of evidence. 


options after high school. 

Ensure that all students feel that their school 
challenges them academically and expects 
them to prepare for a productive future after 
high school. 99 For programs with a career 
focus, offer integrated courses that combine 
career education with traditional academic 
subjects. Example 3.3 summarizes two 
courses approved by the University of Cali¬ 
fornia Curriculum Integration office to teach 
career-related content in high school while 
also meeting requirements for entrance into 
the state university system, and Example 
3.4 shows how college-focused lessons can 
be used to teach academic standards in 
middle school or high school. Career pro¬ 
grams can also offer dual-enrollment courses 
through local colleges to allow students to 
earn college credit and to expose them to 
college-level work in the career field. For 
schools with a college focus, ensure that 
each student’s individual graduation plan 
includes enough dual-credit courses to fulfill 
the school’s goal for college credits at gradu¬ 
ation. Some students may need a supplemen¬ 
tal math course or English course to succeed 
in college preparatory classes. 
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EXAMPLE 3.1 


Checklist for effective college-focused programs 100 


Key elements of college 
focused programs 


Key elements of college 
focused programs 

Examples of elements in practice 

V All students receive college- 
preparation coursework and 
any additional academic sup¬ 
port needed to meet these 
expectations. 

Each student’s graduation plan aligns with course require¬ 
ments for admission to the state’s university system, such 
as a minimum of 4 years of math and 2 years of a laboratory 
science. Students who enter 9th grade behind in math get a 
daily supplemental math course to get them back on track for 
meeting college entrance requirements. 

V The school has an established 
partnership with a local col¬ 
lege. As part of this partner¬ 
ship, a college faculty member 
serves as a liaison between the 
college and the school. 

School leadership partners with the chair of the psychology 
department at a local community college. The department chair 
acts as the primary contact for designing a dual-enrollment 
course, facilitating college tours, and establishing dual-credit 
agreements. 

V Students’ course of study 
includes dual-enrollment 
courses that allow students 
to experience college-level 
coursework. 

School leadership and a faculty member at a local community 
college work together to design a college course that teaches 
critical-thinking skills, with a focus on writing and presenta¬ 
tions. The course introduces students to the rigors of college 
coursework and shows students that they belong in a college 
environment. 

V Students’ course of study 
allows them to earn college 
credits, with an explicit goal 
of having a degree or certain 
number of transferable credits 
upon graduation. 

Each student’s graduation plan results in up to 2 years of 
college credit that can be transferred to a 4-year institution 
and/or result in an associate’s degree. Credit is earned 
through dual-enrollment courses offered at a nearby college 
and dual-credit classes offered at the high school that qualify 
for both high school and college credit. 


Examples of elements in practice 
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EXAMPLE 3.2 


Checklist for effective career-focused programs 101 


Key elements of career 
focused programs 


Key elements of career 
focused programs 

Examples of elements in practice 

V Learning materials are chosen 
and adapted to focus on an 
industry that is connected 
to regional workforce needs. 

The school reviews data from the local and state economic- 
and workforce-development agencies and identifies health 
science as a high-demand industry in their area. The school 
then chooses learning materials that focus on careers within 
the health science industry, such as patient care and commu¬ 
nity health. 

V The career coursework and 
experiences are aligned with 
industry standards. 

An engineering program aligns coursework with manufac¬ 
turing industry standards for entry-level employment. The 
school establishes an industry advisory board with local 
employers to identify relevant certification standards. 

V The academic curriculum 
enables students to learn 
skills related to the industry. 

Students in a medical sciences program learn to calculate 
medication dosages in their Algebra I class or study biomet¬ 
rics in their statistics class. 102 

V Local community colleges 
or technical schools advise 
on the industry-related cur¬ 
riculum and relevant student 

outcomes. 

A school focused on advanced manufacturing partners with 
the local technical college to offer a dual-credit course in 
computer-integrated manufacturing. A representative from 
the college serves on the school’s industry advisory board 
to advise on the manufacturing training curriculum. 

V Students participate in work- 
based learning that links 
classroom activities with work 
experiences, such as job shad¬ 
owing and career mentoring. 

A school focused on hospitality and tourism partners with 
local employers to offer job-shadowing experiences at area 
hotels and tourist attractions over spring break. 

V Counselors create an individu¬ 
alized graduation plan 
for each student based 
on students’ career and 
education goals. 

Starting in 9th grade, students work with their counselors 
to complete an individual graduation plan. Plans align stu¬ 
dents’ career goals with their course of study, work, and 
extracurricular experiences, as well as giving students 
feedback on how their academic progress relates to their 
post-high school goals. 

V The career coursework is 
regularly evaluated against 
student outcomes and the 
needs of local industry 
and partners. 

At the end of every year, a team of school staff examines 
academic outcomes, such as test scores, and measures of 
student engagement, such as climate surveys and attendance 
rates, to evaluate how the program can better meet student 
needs. Data are shared with the industry advisory board 
for input on how the program can be more relevant to 
local employers. 


Examples of elements in practice 
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EXAMPLE 3.3 


Sample University of California Curriculum Integration courses that 
integrate academic and career technical education content 103 

The University of California Curriculum Integration (UCCI) office develops courses that integrate 
academic subjects with career technical education content. UCCI courses also meet the University 
of California standards for course content and rigor needed to count toward admission to the 
University of California or California State University systems. 


Examples of courses: 

Physics and Engineering: Motion by Design 

Students develop an understanding of fundamental concepts in physics and engi¬ 
neering and apply these concepts to a product-design cycle. Students design mar¬ 
ketable products and develop skills in computer programming, 3-D modeling, and engineering 
technology. Assignments include designing a rotating pulley using computer-assisted design 
(CAD) software and producing a quality-control report that includes data from product testing. 

V Meets the University of California standards for a laboratory science course. 

English 12 and Entrepreneurship: The Business of Agriculture 

Students learn about the agriculture industry while building the communication, critical-thinking, 
and business skills needed to develop and pitch a business plan. Students develop knowledge 
and skills in conducting research, reading nonfiction, oral communication, legal concepts, and 
marketing. Assignments include a group project analyzing and presenting solutions to sustain¬ 
ability issues within the California almond industry and developing a business plan based on 
an analysis of market opportunities within their neighborhood. 

V Meets the University of California standards for an English course. 



EXAMPLE 3.4 


Sample college-focused lessons that teach specific academic standards 104 

The Realizing the College Dream curriculum guide offers ideas for lessons that increase students’ 
awareness of college while also teaching middle school and high school academic standards in 
core subject areas. An example follows. 


Lesson. Students compare and contrast different financial-aid packages from four different 
institutions for a fictional student, building an understanding of concepts such as net cost and 
the basic types of financial aid. Students present the advantages and disadvantages of each 
financial-aid package and present their recommendation for the college they think the student 
should attend, and why. 

Related Mathematics and Social Studies Standards (National Council of Teachers of 
Mathematics and National Council for the Social Studies): 

• Mathematics number and operations: Students develop fluency in operations with real 
numbers, vectors, and matrices, using mental computation or paper-and-pencil calculations 
for simple cases and technology for more complicated cases; students judge the reasonable¬ 
ness of numerical computations and their results. 

• Production, distribution, and consumption: Learners expand their knowledge of economic 
concepts and principles, and use economic reasoning processes in addressing issues related to 
the four fundamental economic questions. (Grades 6-8) 
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Reinforce the relevancy of coursework by 
creating a continuum of experiential learning 
outside the classroom that builds awareness 
of the connections between high school and 
students’ college or career goals (Example 
B.5). This might include work-based learn¬ 
ing experiences that begin with bringing in 
outside speakers to discuss their professions 
and culminate with a summer internship 
before senior year. For schools with a college 


focus, activities might start with an alumni 
panel discussing their college experience and 
culminate with students enrolling in a college 
course. Community resources, such as area 
employers, nonprofit organizations, and col¬ 
leges, can support these efforts by providing 
guest speakers, hosting students for tours or 
job shadowing, and coordinating internships 
or dual-enrollment courses. 


EXAMPLE B.5 


Continuum of experiential learning 105 



9th grade 

10th grade 

11th grade 

12th grade 


ft 

Build awareness 

a 

Explore options 

Develop relevant 
knowledge and skills 

Gain hands- 
on experience 

How it looks in practice... 

Health careers 
academy 

Employees from 
the local hospital 
discuss their 
professions at 
career day. 

Students complete 
a spring break job 
shadow at the local 
hospital, learning 
about different medi¬ 
cal careers. 

Students take a 
medical clinical 
class that com¬ 
bines instruction in 
clinical skills with a 
twice weekly intern¬ 
ship at the local 
hospital. 

The summer 
after junior 
year, students 
complete an 
internship in 
the medical 
field. 

Early college 
pathway 

Alumni who are 
enrolled in col¬ 
lege return to 
talk with stu¬ 
dents about their 
experience. 

Students tour area 
colleges and prepare 
a presentation about 
a college they are 
interested in attend¬ 
ing, including admis¬ 
sions requirements, 
academic programs, 
and extracurricular 
opportunities. 

Students complete 
college essays dur¬ 
ing their English 
language arts class 
and compare finan¬ 
cial aid packages 
during math or 
social studies class. 

Students com¬ 
plete a dual¬ 
enrollment 
course at the 
local commu¬ 
nity college. 


2. Provide curricula and programs that help students build supportive relationships and 
teach students how to manage challenges. 


Students with stronger social and emotional 
skills generally have better academic out¬ 
comes. 106 The Collaborative for Academic, 
Social, and Emotional Learning (CASEL) has 
identified five key social and emotional 


learning (SEL) competencies that are impor¬ 
tant to student success in school and life (see 
Example B.6): self-awareness, self-manage¬ 
ment, social awareness, relationship skills, 
and responsible decision-making. 
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Recommendation 3 (continued) 


EXAMPLE 3.6 


CASEL Framework for Social and Emotional Competencies 107 

The Collaborative for Academic, Social, and Emotional Learning (CASEL) has developed a frame¬ 
work for the skills students need to effectively manage daily challenges. Their framework focuses 
on skills grouped under five core competencies: 

Self-awareness: Social awareness: 


• identifying emotions 

• accurate self-perception 

• recognizing strengths 

• self-confidence 

• self-efficacy 

Self-management: 

• impulse control 

• stress management 

• self-discipline 

• self-motivation 

• goal-setting 

• organizational skills 


• perspective-taking 

• empathy 

• appreciating diversity 

• respect for others 

Relationship skills: 

• communication 

• social engagement 

• relationship-building 

• teamwork 


Responsible 

decision-making: 

• identifying problems 

• analyzing situations 

• solving problems 

• evaluating 

• reflecting 

• ethical responsibility 


The panel recommends implementing explicit 
social and emotional training through either 
classroom curricula or separate programs that 
are offered outside of the classroom, depend¬ 
ing on student risk level for low engagement. 
Skills taught through curricula and programs 
might include how to make better decisions 
in high-stakes situations, strategies for stress 
and anger management, and setting and 
tracking progress toward goals. Curricula and 
programs can also improve student engage¬ 
ment by teaching relationship-building skills 
through mentoring, peer support groups, 
and by fostering positive engagement with 
family and peers. Positive relationships within 
school, particularly between teachers and 
students, help students to develop a sense of 
belonging in school and reduce the likelihood 
that students will disengage. 108 

Use separate programs for groups of stu¬ 
dents who are at risk for low engagement, 
such as those transitioning to middle or high 
school, or for those already showing signs of 


disengagement through low attendance rates 
and declining grades. Offer a peer mentoring 
program in which older students are care¬ 
fully selected and trained to lead incoming 
9th-grade students in group sessions that 
build students’ social and emotional skills. In 
addition to teaching coping skills, mentoring 
provides students with positive peer relation¬ 
ships in school. Peer mentoring programs can 
be integrated into the school day by creating 
a leadership course in which mentors meet 
with faculty advisors 4 times a week to prac¬ 
tice mentoring skills and then meet once a 
week with freshman students to lead a group 
mentoring session. 109 

To implement this recommendation with all 
students, the panel believes that instruction 
on managing challenges should be integrated 
into regular classroom instruction. This 
might include using a curriculum for explicit 
instruction on skills or coaching students on 
positive behaviors during everyday classroom 
activities. For example, use group work to 
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Recommendation 3 (continued) 


teach students positive approaches to work¬ 
ing with peers. Start a group work lesson by 
asking the class to establish a list of “do’s and 
don’ts” for constructive group work. Finish 
the lesson with a class discussion in which the 
teacher and students share examples of good 
group work behavior that they observed, and 


students reflect on what could be improved 
during group work." 0 Additionally, train 
teachers to use their daily interactions with 
students to reinforce students’ sense of 
belonging in school and strengthen teacher- 
student trust (see Example 3 . 7 ). 


EXAMPLE 3.7 


Everyday strategies for teachers to foster student engagement ,n 


Strategy 

Why? 

What does this look like? 

Acknowledge 
each student 
as they enter 
your classroom 

Noticing each student every day helps 
students feel connected to school 
and shows that someone cares. Greet¬ 
ing students at the beginning of each 
day or class with a simple question or 
positive comment lets students know 
they are valued in the school. 

• “Hi [student name]. 

It's good to see you.” f | 

• “How was your V- 

weekend?” 

• “How is your project 
coming along?” 

Praise students’ 
effort and 
process 

Emphasize the role of students’ effort 
and persistence in feedback on their 
work. This will reinforce that students 
have the ability to improve in a sub¬ 
ject through work and that ability is 
not a fixed trait. 

• “I like the way you approached this 
problem. Can you tell me about 
what you did?” 

• “I see that you worked hard on this 
assignment.” 

• “Your response is very creative. Can 
you explain your thinking?” 

Help students 
set goals and 
monitor prog¬ 
ress toward 
the goals 

Having students set ambitious, yet 
achievable, goals and marking prog¬ 
ress toward those goals helps students 
develop strategies for self-manage¬ 
ment. Goal-setting also develops stu¬ 
dents’ belief in their capacity to reach 
a goal through hard work. 

• “What is a goal you want to achieve 
this week?" 

• “What do you think is the biggest 
obstacle to achieving this goal?” 

• “How can you overcome that 
obstacle?” 

Use a student- 
centered 
approach to 
classroom 
discipline 

At the beginning of the school year, 
establish clear expectations for student 
behavior in collaboration with students. 
When a student misbehaves, ask the 
student to reflect on the reasons for 
his or her behavior and strategies that 
could have led to better decisions. 

• “What kind of classroom norms 
do we need so that every student 
has an opportunity to share his or 
her ideas?" 

• “How do you think your behavior 
made your classmates feel?” 

• “What other strategies could you 
have used in this situation?” 
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Districts and states can help schools prioritize 
teaching social and emotional skills by devel¬ 
oping SEL standards with benchmarks for 
skills students should develop at each grade 


level. Example B.8 provides sample 
SEL standards from the Illinois State Board 
of Education. 


EXAMPLE B.8 


Sample social and emotional learning standards, Illinois State Board of Education 112 

Goal 

Standard 

Grade level and 
benchmarks 

Sample performance 
descriptors 

Students use 
social-aware¬ 
ness and inter¬ 
personal skills 
to establish 
and main¬ 
tain positive 
relationships. 

Students dem¬ 
onstrate an 
ability to pre¬ 
vent, manage, 
and resolve 
interpersonal 
conflicts in 
constructive 

ways. 

In early high school: 

• analyze how listen¬ 
ing and talking accu¬ 
rately help in resolving 
conflicts. 

• analyze how conflict 
resolution skills con¬ 
tribute to work within 
a group. 

• Evaluate the effectiveness of 
various strategies for dealing 
with negative peer pressure. 

• Practice peer-mediation 
skills. 

• Role-play de-escalating a 
conflict to avoid a fight. 

Students dem¬ 
onstrate deci¬ 
sion-making 
skills and 
responsible 
behaviors 
in personal, 
school, and 
community 
contexts. 

Students apply 
decision-mak¬ 
ing skills to 
deal respon¬ 
sibly with 
daily academic 
and social 
situations. 

In middle school/junior 
high school: 

• analyze how decision¬ 
making skills improve 
study habits and aca¬ 
demic performance. 

• evaluate strategies for 
resisting pressure to 
engage in unsafe or 
unethical activities. 

• Practice aligning nonverbal 
and verbal communication in 
refusing unwanted behavior. 

• Describe the effects of pro¬ 
crastination and disorganiza¬ 
tion on academic outcomes. 

• Use a decision log for 24 hours 
to identify influences on own 
health decisions. 


To reinforce skills taught through separate 
programs or classroom instruction, students 
will need regular opportunities to practice 
and apply their skills. Use role-playing exer¬ 
cises like the one described in Example B.9 to 
allow students to practice and reflect on their 
social and emotional skills in and out of the 
classroom. Everyday activities, such as class¬ 
room group work, behavioral incidents, and 


daily interactions with students, also provide 
opportunities for teachers and other school 
staff to coach students on strategies for man¬ 
aging conflict and allow students to practice 
their skills. Once students are taught social 
and emotional skills, they can also practice 
them outside of school through service-learn 
ing projects and internships. 
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EXAMPLE 3.9 


Sample role-playing activity for conflict-management skills 113 

The instructor leads the class in a role-playing exercise in which students work 
in pairs to demonstrate appropriate and inappropriate ways to manage conflict. 

The instructor divides the class into pairs. Student A is told to borrow an object from student B 
Student B should then imagine that some time has passed and student A has failed to return 
the borrowed object. Student B then role-plays trying to get the object back in two ways: (1) in 
an out-of control manner, using an aggressive attitude or action, and (2) an in-control manner, 
using a positive attitude or action. 


Once the students have role-played both scenarios, the instructor should generate a discussion 
with students on the differences between the two ways in which they attempted to get their 
object back. The goal of the discussion is for students to realize that there is a positive way to 
manage conflict, and that this can often yield better results. During the discussion, the instruc¬ 
tor should try to highlight skills such as stress management, self-control, social values, dealing 
with anger or hostility, and peer group behaviors. 

Examples of discussion prompts: 

• If this situation occurred outside of school, how many of you would initially react in an 
out-of-control manner? 

• How might you react differently in school? 

• What are some of the skills needed to be able to react in an in-control manner? 

• What are some of the benefits of acting in an in-control manner in this situation and in 
situations like this? 



3. Regularly assess student engagement to identify areas for improvement, and target 
interventions to students who are not meaningfully engaged. 


Administer school climate and student 
engagement surveys annually. Analyze 
survey results along with regularly monitored 
early warning indicators, such as attendance 
and grades (as described in Recommendation 1). 
The panel believes that school climate and 
student engagement surveys can supplement 
early warning indicators, helping staff iden¬ 
tify the root cause behind low attendance 
rates or slipping grades. For example, early 
warning indicators may show low attendance 
among 9th-grade students, indicating that 
students are disengaging from school. The 
school climate survey can supplement that 
information by showing low levels of trust 
between students and teachers, or a feeling 


Free school climate and student 
engagement surveys 114 


Survey name 

Provider 

ED School Climate 
Surveys (EDSCLS) 

U.S. Department 
of Education 

5Essentials Survey 

University of 
Chicago 

GALLUP Student 

Poll 

Gallup, Inc. 
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among students that the school does not 
have high expectations for postsecondary 
success for all students. 

There are several free school climate and stu¬ 
dent engagement surveys available. 115 Choose 
a survey tool that is valid (accurately measures 
what it says it will measure) and reliable 
(measures those concepts consistently across 
questions, over time, and across different 


school environments). The survey should also 
align with what the school staff and com¬ 
munity have decided is important for student 
engagement in their school, and with concepts 
that research shows are related to student 
outcomes. 116 Example B.10 provides sample 
survey questions on academic engagement, 
student-teacher trust, and the importance 
of school for the future, concepts which are 
related to higher student engagement. 117 


EXAMPLE 3.10 


Sample student engagement survey questions 118 

How much do you agree with the following statement... 

What is being 
measured 

• I usually look forward to this class. 

• I work hard to do my best in this class. / • / 

• Sometimes I get so interested in my work I don’t want to stop. / r 1 

• The topics we are studying are interesting and challenging. ^ 

Academic 

engagement 

• When my teachers tell me not to do something, I know they have a good reason. 

• I feel safe and comfortable with teachers at this school. 

• My teachers always keep their promises. 

• My teachers will always listen to students’ ideas. 

• My teachers treat me with respect. 

Student- 

teacher 

trust 

• My classes give me useful preparation for what I plan to do in life. 

• High school teaches me valuable skills. 

• Working hard in high school matters for success in the workforce. 

• What we learn in class is necessary for success in the future. 

• I have someone who is helping me with my college and career goals. 

Importance 
of school for 
the future 


In addition to assessing schoolwide strengths 
and weaknesses, use annual survey data, 
along with the ABC data described in Recom¬ 
mendation 1, to identify groups of students 
with low levels of engagement. For example, 
if entering 9th-graders report few positive 
peer relationships or low levels of student- 
teacher trust, invest in a peer mentoring pro¬ 
gram or curriculum focused on building social 


and emotional skills. Or, if engagement data 
indicates that students don’t see their course- 
work as relevant to their future, establish 
teacher teams to focus on using integrated 
coursework that connects academic skills 
with future college or career options. These 
interventions can supplement the interven¬ 
tions described in Recommendation 1. 
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Potential obstacles to implementing Recommendation 3 and the panel’s advice 


Obstacle 3.1. Teachers are focused on tradi¬ 
tional academics and resistant to integrating 
a career curriculum. 

Panel’s advice. Teachers of academic sub¬ 
jects may not be comfortable integrating 
a career theme into their regular academic 
instruction because they are not knowledge¬ 
able about that career theme and have not 
been trained on integrating career and aca¬ 
demic topics during instruction. 119 Provide 
teachers with additional support and build 
their knowledge of the career topic through 
partnerships with industry experts. Establish 
an industry advisory board with area employ¬ 
ers and representatives of technical schools 
or area colleges to support teachers by 
advising on lesson plans, hosting teachers for 
jobsite visits, and volunteering employees to 
provide feedback on student work. 120 

Teachers may also be concerned that the 
career focus will take time away from instruc¬ 
tion required to meet state standards, jeop¬ 
ardizing their ability to prepare students for 
end-of-year exams. Provide teachers with 
time during the school week to collaborate 
as cross-subject teams and plan lessons. Plan 
professional development to support teachers 
in developing an integrated curriculum by pro¬ 
viding training on aligning lessons with state 
standards and creating project-based lessons 
that combine the career focus and multiple 
academic subjects. Utilize existing resources 
that have already developed integrated lesson 
plans, such as the University of California Cur¬ 
riculum Integration courses (see Example B.B). 
Emphasize that adding a career focus can help 
engage students in the content. 

Districts can support teachers in integrating 
academic and career curricula by encourag¬ 
ing collaboration among district-level career 
education and curriculum and instruction 
staff. 121 Districts can also provide schools with 
flexibility in choosing a curriculum that allows 
teachers to teach both academic and career- 
related standards. 122 


Obstacle 3.2. We do not have enough staff to 
deliver a program focused on building stu¬ 
dents’ capacity to manage challenges in and 
out of school. 

Panel’s advice. Schools do not need to hire 
additional staff to oversee a separate pro¬ 
gram. Instead, infuse the teaching of social 
and emotional skills into the regular curricu¬ 
lum through structured group work, modeling 
skills for students, and explicit instruction on 
problem-solving or decision-making skills (see 
Example 3.7). Districts and states can support 
schools in integrating SEL into instruction by 
adopting SEL standards for each grade level, 
providing sample lesson plans, and profes¬ 
sional development (see Example 3.8). 

Students who show signs of low engage¬ 
ment may need additional support beyond 
what teachers can provide during classroom 
instruction. Offer these students a peer 
mentoring program that is integrated into the 
regular school day, and provide selected peer 
mentors with training and oversight through 
a credit-bearing leadership course that meets 
as a regularly scheduled class. One class 
a week can be a mentoring session during 
which peer mentors meet with their mentees 
and implement an established curriculum. 123 

Obstacle 3.3. We do not have enough time 
during the day for students to practice prob¬ 
lem-solving or anger-management skills. 

Panel’s advice. The school day presents 
many naturally occurring opportunities for 
students to practice skills developed through 
classroom instruction and/or special pro¬ 
grams. Train all staff, including support staff, 
to identify opportunities for students to 
practice those skills. For example, staff can 
respond to misbehavior in the hallway by 
asking students to reflect on the impact of 
their behavior on the school community and 
the decision-making process that led to their 
behavior choice. 
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Recommendation 4 



For schools with many at-risk students, create small, 
personalized communities to facilitate monitoring 
and support. 

Schools with large numbers of at-risk students may struggle to provide students with the 
personalized attention and support described in Recommendations I, 2 and 3. By grouping 
students into small communities of no more than a few hundred students, 124 teachers 
and other school staff will have fewer students to monitor and manage, and will be better 
able to implement Recommendations I, 2, and 3. In a small, personalized community, 
staff can check in with students more frequently, pay closer attention to their needs, form 
stronger and more meaningful relationships with them, and keep track of what troubles 
and motivates them. 125 /4s students, teachers, and other school staff get to know one 
another throughout the year, students will feel more connected to the people in their school 
and develop a greater sense of belonging in the school community, which will help them 
persevere to graduation. 126 

Planning a smaller community typically 
takes an entire year and requires commit¬ 
ment from important stakeholders, including 
parents, staff, and leadership. Because of 
the additional resources required to imple¬ 
ment this recommendation, the panel is only 


recommending creating small communities 
in schools with large numbers of students at 
risk for dropping out. That said, there may 
be benefits for all students, including improv¬ 
ing engagement and promoting college and 
career readiness. 
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Recommendation 4 (continued) 




This guide focuses on creating small com¬ 
munities because it is a practice that can be 
implemented by individual schools, but this 
recommendation can also be implemented 
at the district level by creating small schools. 
The panel believes that it is important to 
create a supportive learning environment in 
which teams of teachers get to know their 
students at a personal level, whether that is 
through small communities within schools or 
whole small schools. 

Summary of evidence: Moderate 
Evidence 

Eight studies contributed to the level of evi¬ 
dence for this recommendation (see Appendix 
D for more information). 127 Six studies meet 
WWC group design standards without reserva¬ 
tions, which is the highest possible rating for 
group design studies and indicates the highest 
degree of confidence that the observed effects 
were caused by the interventions. 128 Two stud¬ 
ies meet WWC group design standards with 
reservations, which indicates a lower degree 
of confidence that the observed effects were 
caused by the interventions. 129 Seven stud¬ 
ies found that the recommended practices 
improved student outcomes in at least one of 
the three outcome domains related to drop¬ 
out prevention, 130 and the four studies that 
examined outcomes in the graduating school 
domain all found positive effects on high 
school graduation. 131 Collectively, the stud¬ 
ies demonstrate moderate external validity, 


If my school is already small, do I 
need to do anything? 

The panel believes that being small by itself 
is not sufficient to address dropout issues. 
The key is to create a more personalized, 
supportive learning environrr 
the students who are strug¬ 
gling. To reap the benefits of 
smallness, the panel recom¬ 
mends implementing the 
action steps articulated in 
this recommendation. 


examining diverse samples in school settings. 
However, only one study supporting this 
recommendation examines an intervention 
that provides a direct test of this recommen¬ 
dation, 132 and most of the supporting studies 
examine a variation of the recommenda¬ 
tion—creating small schools rather than small 
communities within existing schools. The 
panel believes that the evidence supporting 
small schools is applicable to small communi¬ 
ties within schools as well, because many of 
the key components of small schools—specifi¬ 
cally, personalization, monitoring, and rapid 
intervention—can be replicated in small com¬ 
munities. The studies collectively demonstrate 
strong internal validity and found consistent 
effects on graduation, but the examined 
interventions do not completely align with the 
recommendation’s steps, indicating a moder¬ 
ate level of evidence. 



Steps to carry out the recommendation 


1. Decide whether the small communities will serve a single grade or multiple grades. 


Examine school data to determine whether 
patterns of at-risk students indicate that stu¬ 
dents would be better served with single- or 
multiple-grade communities. For example, if 
the patterns in the school data suggest that 
students begin struggling in the transition 
years (6th or 9th grades), consider creat¬ 
ing single grade transition-year academies. 
Transition-year academies serve all students 
in a specific grade and focus on the particular 


needs experienced by students as they start 
middle school or high school and must adjust 
to new demands and expectations and to 
having more freedom in school. 

Other schools may find that their data indi¬ 
cate worsening trends as the students enter 
higher grade levels. These schools could form 
college- or career-focused communities that 
include all students at multiple grade levels. 
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Recommendation 4 (continued) 



For example, a school may want to create 
smaller, career-oriented communities from 
10th to 12th grade to help students see how 
their education is useful for preparing for 
future careers. 133 

Finally, schools can create smaller communi¬ 
ties that span all grades to allow students to 


develop strong peer relationships that begin 
when they enter school and last through 
graduation. 134 

Example 4.1 describes how transition year and 
10th to 12th grade academies might work in 
practice, using an example case study that will 
continue throughout this recommendation. 


EXAMPLE 4.1 


Case study of a fictional Central High School with a large number of at-risk students 


CASE STUDY 


Mrs. Rickard is the principal at Central High School. Central serves 2,000 students and a large 
portion of students who are off track for graduation. To make it easier to monitor and provide 
proactive interventions (Recommendation 1), to provide adult advocacy and case management 
for students who were already off track (Recommendation 2), and to integrate stronger social 
skills and community-oriented programming (Recommendation 3), she decided to create smaller 
communities. 

Looking at the school data, Mrs. Rickard realized that the freshman rates of absences and course 
failures were troublesome. She decided to create Freshman Academies for all freshman, dividing 
the entire class into five academies, with 100-120 students per academy. 

Mrs. Rickard also realized that students in grades 10-12 were struggling. Struggling students in 
these grades have often shared with her and the school counselor that they did not see a reason 
for continuing in high school. The principal decided the school needed to do something to help 
these students connect their education with something more meaningful, like a specific career 
path (e.g., work in health services, informational technology, or the hospitality industry) or inter¬ 
est area (e.g., science and technology). 

After gauging her students’ and teachers’ level of interest in the small communities and finding 
that some preferred and flourished in the traditional school structure, Mrs. Rickard decided to 
make academy participation voluntary. She created four multi-year grade 10-12 academies, with 
approximately 300 students each, in addition to her five Freshman Academies. Since the rest of the 
grade 10-12 students would remain as a typical school structure, students, parents, and teachers 
could opt in to a grade 10-12 academy if they wanted to join one of these smaller communities. 

To ease implementation, Mrs. Rickard decided to roll out the freshman academies the following 
year and the academies for grade 10-12 in 2 years. 


2. Create teams of teachers that share common groups of students. 


Create teacher teams that work with the same 
students for the entire time students are part 
of the small community (either the entire year 
or multiple years). 135 For example, teachers in 
the grade 10-12 career academy should teach 


their group of students for multiple years, 
preferably all 3 years to allow for continu¬ 
ity. By teaming and remaining with students 
longer, teachers can form stronger, longer- 
lasting relationships with their students and 
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Recommendation 4 (continued) 


provide consistency, even when there is 
some staff turnover. This allows the teachers 
to monitor and proactively intervene with 
students who are at risk for dropping out (see 
Recommendation l). 136 The small community 
will allow teachers to know each student per¬ 
sonally, making it easier for students to ask 
for help from teachers and easier for teachers 
to provide support. 137 

Creating small teacher teams makes it easier 
for teachers to share information about stu¬ 
dents with each other. Teacher teams share 
responsibility for a smaller group of at-risk 
students, allowing them to more easily dis¬ 
tribute the workload for monitoring students’ 
attendance, behavior, and course perfor¬ 
mance and intervening when needed. Also, 
the advocate assigned to higher-risk students 
(see Recommendation 2) will find it easier to 
regularly communicate with their students’ 
teachers, since there are fewer teachers and 
they remain with the students longer. 


Equitably divide the teaching skill and tal¬ 
ent, as well as access to advanced or other 
high-interest courses, across the small 
communities. A single community should 
not have all the most talented and skilled 
teachers or the most challenging and inter¬ 
esting courses. High-quality instruction and 
advanced or elective courses must be avail¬ 
able in every community. 

Determine how the teams will be supported 
with resources and administrative leadership 
within the larger school. Communities can 
be self-contained with their own resources 
and administrative structure, or they can 
share leadership and resources with the 
larger school. Teacher leaders can act as an 
intermediary form of leadership between 
the smaller community and the larger school 
administration. Example 4.2 describes how 
this might look in practice in the case study. 


EXAMPLE 4.2 


Case study, continued: Teacher teams, resources, and leadership for Central High School 


CASE STUDY 


Mrs. Rickard created five teams of freshman academy teachers and four teams of grade 
10-12 teachers for the multi-year academies. Each team included teachers to cover each of 
the core courses (i.e., English language arts, social studies, math, and science). The grade 10-12 
teams also included a career-technical education teacher. The teacher teams were tasked with 
not only teaching the students in their academy, but also monitoring their progress and support¬ 
ing them as needed. 

Mrs. Rickard provided the academies with additional flexibility over scheduling and 
funds for field trips. This flexibility allowed each academy to modify their schedule to integrate 
the academy theme into core course instruction and facilitate team teaching. For example, acad¬ 
emies could combine classes like English language arts and social studies into an integrated 
humanities block, or adjust their schedule to allow students to engage in real-world, multi¬ 
week projects. 

To help her coordinate activities across all nine academies, Mrs. Rickard reorganized 
staff responsibilities so that the freshman academy program and the grade 10-12 
academy program were each overseen by a teacher leader. Teacher leaders worked with 
teacher teams to help with managing resources, monitoring student progress, and coordinating 
student supports. 


(43 ) 










Recommendation 4 (continued) 




3. Identify a theme to help build a strong 
improve student engagement. 

Select a small-community theme, often a 
topic or subject matter, around which the 
small communities can be organized. See 
Example 4.3 for sample themes. The panel 
believes that themes strengthen small com¬ 
munities and facilitate implementing the 
steps described in Recommendation 3. 

Themes provide a sense of shared identity 
for the students in the community; this 
feeling of belonging helps students feel 


sense of identity and community and to 


connected to their schooling. 138 A theme 
also provides opportunities for innovative 
teaching that connects what students are 
learning to what they will be doing after they 
graduate (see Recommendation 3). To help 
students engage in and identify with the 
school theme, plan special activities such as 
speakers, field trips, or community-service 
activities that relate to the theme. 139 


EXAMPLE 4.3 


Sample small-community themes 140 

Broad academic topics 

Specific topics 

Career-related topics 

• Humanities 

• Science and technology 

• Society and culture 

• Performing arts 

• Environmental studies 

• Social justice in America 

• Communications and media 

• Health 

• Public safety 


Involve all stakeholders in determining the 
school theme. 141 Before choosing a theme, 
schools should survey and meet with poten¬ 
tial students, parents, and teachers to narrow 
down a list of themes that may interest them. 
Working with an interdisciplinary team of 
teachers, including potential teacher leaders, 


select a theme for each smaller community 
from those with the highest votes. Themes 
can evolve over time—if students’ interests 
change, consider changing the theme for the 
next year. Example 4.4 describes this step in 
more detail for the case study. 
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EXAMPLE 4.4 


Case study, continued: Creating themed academies for grades 10-12 at Central High School 


CASE STUDY 


To begin choosing themes, Mrs. Rickard informally discussed the idea with her staff 
to gauge their interest in themed academies. She provided examples of themes other 
schools had generated. From these conversations, she helped the group generate an initial 
list of themes. 

The initial list of more than 20 themes was used in a survey of parents, students, 
and school personnel. By surveying the school community, she narrowed the list of possible 
themes to 8. 

Mrs. Rickard then met with potential teacher leaders from multiple disciplines. Together 
they chose themes for each community from those with the highest votes that they felt would 
interest students, parents, and teachers. They chose (1) policing and public service, (2) medical 
and health-related careers, (3) visual and performing arts, and (4) science and technology careers. 

The themes were shared with all incoming students in grades 10-12. Students were asked 
to apply to their top three choices. Mrs. Rickard considered student preferences and student 
characteristics to assign them to academies. She sought to match students with themes they 
were interested in while also creating a heterogeneous mix of students in each community that 
reflected the demographics of the larger school. This ensured students were able to interact with 
a diverse group of their peers in the small communities. 

Art teachers worked with students in each community to develop 
a logo to represent their theme. These logos were used to identify 
the community in school publications and to create community t-shirts. 

Students were asked to wear their t-shirt every Friday to promote 
their community. 

The teachers in each community planned projects, speakers, 
and held trips related to the theme of their community. For example, 
students in the medical and health academy took courses in CPR/AED training, 
anatomy and physiology, and health skills. They also shadowed healthcare 
workers in hospitals and local medical centers. Similarly, students in the visual and performing 
arts academy took courses in drama, vocal performance, and instrumental music in addition to 
their core courses. They also participated in choirs and orchestras, performed at local commu¬ 
nity events, and visited local performing arts centers. 
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Recommendation 4 (continued) 


4. Develop a schedule that provides common planning time and ample opportunities 
for staff to monitor and support students. 


To help students and teachers get to know 
one another, develop a master schedule that 
permits teachers and students to remain in 
their community most of the day. More than 
half the classes taught by the teacher team 
should be within the smaller community, 
and students should take most, if not all, 
courses from teachers in their communities. 142 
Example 4.5 describes how this might work in 
practice in the case study. 

Master schedules should also include com¬ 
mon planning times for teacher teams. 143 
Common planning times can occur during 
shared periods throughout the day, a late 


start or early release day each week, or a time 
during a block schedule when students are 
engaged in other activities. Teacher teams 
should use their common planning times to: 

■ develop activities that relate to the theme 
of the community, link course content to 
the theme, and further engage students 
in getting to know their community; 

■ collaboratively identify concerns and 
develop solutions; and 

■ discuss academic and behavioral progress 
with students and their parents. 


EXAMPLE 4.5 


Case study, continued: Developing a schedule for Central High School 


CASE STUDY 


Mrs. Rickard realized that, with the old schedule, teachers were so busy teaching six classes 
a day, class after class, that they didn’t have time to work together or to get to know their 
students. Teachers and students needed a new schedule that would allow them to remain together for 
most, if not all, of their day. She wanted her teacher teams to be able to fully focus on the community 
and not be torn between their small community and other school responsibilities. 

Mrs. Rickard also wanted the teacher teams to have sufficient time 
to develop integrated lessons and activities that would enhance the 
theme of their communities and enable them to get to know their students, 
what they are struggling with, and ways to address those concerns. She 
worked with her administrators to create a schedule that allowed teacher teams 
3 hours of shared common planning time every Wednesday afternoon. She 
specifically chose a day during the middle of the week to discourage absences that 
might occur on shortened days so close to the weekend (i.e., Monday or Friday). 

Mrs. Rickard also instituted specific tasks for teachers to accomplish during this time to ensure 
the time was used well. During this common planning time, teams were asked to (1) debrief the pre¬ 
vious week, what worked well and what didn’t, (2) discuss student progress and any problems that 
needed to be addressed, and (3) develop interdisciplinary lessons and activities for the following week 
that would support school communities. 

Mrs. Rickard also worked with her teacher teams to find a time each week for the small commu¬ 
nities to work on a theme-related project/activity or to attend a community event or speaker related to 
their theme. 
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Potential obstacles to implementing Recommendation 4 and the panel’s advice 


Obstacle 4.1. It takes too much time, effort, 
and resources to create these small communi¬ 
ties. We are not sure it is worth it. 

Panel’s advice. Creating small communities 
is no simple task. It takes more than a year 
to plan and requires extensive leadership 
commitment and stakeholder involvement. It 
may also involve restructuring of the physi¬ 
cal space and administrative structure in a 
school. Given the time, effort, and resources 
needed to create these small communities, 
the panel recommends creating small com¬ 
munities in schools with large numbers of 
at-risk students. These efforts may be costly, 
but schools with small learning communities 
have been found to have positive effects on 
staying in school, progressing in school, and 
graduating school. 144 

Obstacle 4.2. Some teachers and parents 
fee! that the smaller learning communities 
will not provide the diverse peer experiences 
that contribute to learning and may lead to 
sorting students by academic achievement 
or motivation. 

Panel’s advice. Develop selection crite¬ 
ria and a transparent assignment system 
to ensure that all students have equitable 
access to these smaller learning communi¬ 
ties. For example, schools can develop 
criteria that favor enrolling similar numbers 
of at-risk students in each community. The 
administrator should keep those criteria in 
mind when assigning students to small com¬ 
munities. After at-risk students are assigned 
to the small community, use a lottery system 
to fill the remaining spots to form a com¬ 
munity that demographically represents the 
larger community. 

If it is not an option to use selection cri¬ 
teria to promote diversity, there are other 


approaches schools can use to promote 
diverse peer experiences. Some small learn¬ 
ing communities are structured so that 
students take core and themed classes 
within the community, and other classes with 
students throughout the school. Small learn¬ 
ing communities can also consider partner¬ 
ing with other schools to offer classes or 
extracurricular activities together to facilitate 
diverse peer experiences. 

Obstacle 4.3. Some parents and students are 
not enthusiastic about the theme(s) of their 
small community. 

Panel’s advice. Involve all the constituents 
(teachers, parents, students) in the selec¬ 
tion of the themes from the beginning. Once 
themes are identified, it is equally important 
to ensure that parents and students know 
about each available theme so they can make 
informed decisions in applying to those they 
are interested in. 

Before students and parents choose which 
community to join, encourage students to 
reflect on their interests, skills, and career 
aspirations. The U.S. Department of Labor 
website includes a self-assessment that 
students can use to help identify their inter¬ 
ests. 145 Encourage students to choose a theme 
that fits their own interests, rather than those 
of their friends. 

Students’ interests may change during their 
time in the community, and they may wish to 
pursue a different theme, similar to changing 
majors in college. Schools can offer “open 
enrollment” periods to accommodate these 
changes, so long as implications for gradua¬ 
tion requirements are not major. As discussed 
above, schools should preserve the flexibility 
to change themes from one year to the next if 
there are widespread shifts in interests. 
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Obstacle 4.4. Teachers are concerned that if 
they have to teach within a small community, 
they will need to teach subjects in which they 
have little expertise. 

Panel’s advice. Teachers might be asked 
to teach more than one course within their 
subject matter experience (e.g., Introduction 
to Chemistry and Advanced Chemistry), but 
it is highly unlikely that they will be asked to 
teach courses for which they are not cre- 
dentialed (since doing so may violate state 
regulations). Teachers may well have more 
unique “preps” than in the past (e.g., three 
rather than two different levels of English, or 
both American and Western European his¬ 
tory). To reduce the burden, have colleagues 
who have already taught those courses 
share their curricular materials. Alterna¬ 
tively, teaching multiple classes in a subject 
might be offset by the introduction of block 


scheduling, so the number of preps in any 
given day will not increase. 

Obstacle 4.5. We need to help students now, 
not in the year it will take to create a small 
community. 

Panel’s advice. To reap the benefits sooner, 
implement key strategies used in small com¬ 
munities as soon as possible. These can 
include alternative or block scheduling that 
allows teachers to be responsible for fewer 
students and a teacher advisory program 
where teachers are assigned to a small num¬ 
ber of students for whom they are respon¬ 
sible over multiple years. By implementing 
these strategies first, schools may reap some 
of the benefits of a small community before 
they are able to fully implement the smaller 
learning community approach. 
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Glossary 


D 


Dropping out occurs when students leave school for any reason before they earn a high school 
diploma without transferring to another elementary or secondary school. 

E 


An early warning system is a set of indicators, data, and reports used to monitor student progress 
and a process for using the data to inform and direct interventions or responses when the data indicate 
students are in need of additional supports. 

Evidence-based practices, policies, or recommendations are supported by studies that meet WWC 
design standards with or without reservations. 

G 


Graduating school refers to graduation from high school with a high school diploma. 

M 


Multi-component interventions include multiple instructional practices related to more than one 
recommendation. Multi-component interventions are also referred to as “bundled interventions.” 

O 


Students who are off track for graduation have low attendance rates, behavioral problems, or 
academic problems that put them at risk of dropping out. 

Outcome domains are groups of closely-related outcomes. A domain is the organizing construct 
for a set of related outcomes through which studies claim effectiveness. In practice guides, the WWC 
assesses the rigor of evidence on the effectiveness of interventions or practices within each domain 
identified in the review protocol. The review protocol for Preventing Dropout in Secondary Schools 
includes three outcome domains: staying in school, progressing in school, and graduating school. 

P 


Measures of progressing in school include the number of high school course credits the student 
has earned, whether the student was promoted to the next grade, and the highest grade the student 
has completed. It also includes on-track indicators, which are based on multiple indicators of student 
progress (e.g., credit accumulation and course failures). 
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s 


Small communities (or small learning communities) create smaller groups of students within a school 
that are led by dedicated teacher teams to provide a more personalized experience. 

Social and emotional learning and/or skills encompass the behaviors, attitudes, and strategies 
needed to deal effectively with daily challenges, including managing emotions, setting and achieving 
goals, showing empathy for others, establishing and maintaining positive relationships, and making 
responsible decisions. 

Measures of staying in school include whether a student has dropped out of school and the number 
of days the student was enrolled in school. 
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Appendix A 


Postscript from the Institute of Education Sciences 

What is a practice guide? 

The Institute of Education Sciences (IES) publishes practice guides to share evidence and expert 
guidance on addressing education-related challenges not readily solved with a single program, 
policy, or practice. Each practice guide’s panel of experts develops recommendations for a coherent 
approach to a multifaceted problem. Each recommendation is explicitly connected to supporting 
evidence. Using What Works Clearinghouse (WWC) group design standards and WWC pilot regres¬ 
sion discontinuity standards, the supporting evidence is rated to reflect how well the research 
demonstrates the effectiveness of the recommended practices. Strong evidence means positive find¬ 
ings are demonstrated in multiple well-designed, well-executed studies, leaving little or no doubt 
that the positive effects are caused by the recommended practice. Moderate evidence means well- 
designed studies show positive impacts, but there are questions about whether the findings can be 
generalized beyond the study samples or whether the studies definitively show evidence that the 
practice is effective. Minimal evidence means that there is not definitive evidence that the recom¬ 
mended practice is effective in improving the outcome of interest, although there may be data to 
suggest a correlation between the practice and the outcome of interest. (See Table A.l for more 
details on levels of evidence.) 


How are practice guides developed? 

To produce a practice guide, IES first selects a 
topic. Topic selection is informed by inquiries 
and requests to the WWC Help Desk, a limited 
literature search, and evaluation of the topic’s 
evidence base. Next, IES recruits a panel chair 
who has a national reputation and expertise 
in the topic. The chair, working with IES and 
WWC staff, then selects panelists to co-author 
the guide. Panelists are selected based on 
their expertise in the topic area and the 
belief that they can work together to develop 
relevant, evidence-based recommendations. 
Panels include two practitioners with exper¬ 
tise in the topic. 

Relevant studies are identified through panel 
recommendations and a systematic literature 
search. These studies are then reviewed 
against the WWC group design standards 
by certified reviewers who rate each effec¬ 
tiveness study. The panel synthesizes the 
evidence into recommendations. WWC staff 
summarize the research and help draft the 
practice guide. 


independently of the IES staff that supported 
the development of the guide. A critical task 
of the peer reviewers of a practice guide is 
to determine whether the evidence cited in 
support of particular recommendations is 
up-to-date and that studies of similar or bet¬ 
ter quality that point in a different direction 
have not been overlooked. Peer reviewers 
also evaluate whether the level of evidence 
category assigned to each recommendation is 
appropriate. After the review, a practice guide 
is revised to meet any concerns of the review¬ 
ers and to gain the approval of the standards 
and review staff at IES. 

Institute of Education Sciences 
levels of evidence for What Works 
Clearinghouse practice guides 

This section provides information about the 
role of evidence in lES's WWC practice guides. 

It describes how practice guide panels deter¬ 
mine the level of evidence for each recommen¬ 
dation and explains the criteria for each of 
the three levels of evidence (strong evidence, 
moderate evidence, and minimal evidence). 


IES practice guides are then subjected to 
external peer review. This review is done 
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the panel’s judgment of the quality of the 
existing research to support a claim that, 
when these practices were implemented in 
past research, positive effects were observed 
on student outcomes. After careful review of 
the studies supporting each recommendation, 
panelists determine the level of evidence for 
each recommendation using the criteria in 
Table A.l. The panel first considers the rel¬ 
evance of individual studies to the recommen¬ 
dation and then discusses the entire evidence 
base, taking the following into consideration: 

■ the number of studies 

■ the study designs 

■ the internal validity of the studies 

■ whether the studies represent the range 
of participants and settings on which the 
recommendation is focused 

■ whether findings from the studies can be 
attributed to the recommended practice 

■ whether findings in the studies are consis¬ 
tently positive 

A rating of strong evidence refers to consis¬ 
tent evidence that the recommended strate¬ 
gies, programs, or practices improve student 
outcomes for a diverse population of stu¬ 
dents. 146 In other words, there is strong causal 
and generalizable evidence. 

A rating of moderate evidence refers either 
to evidence from studies that allow strong 
causal conclusions but cannot be generalized 
with assurance to the population on which a 
recommendation is focused (perhaps because 
the findings have not been widely replicated) 
or to evidence from studies that are generaliz¬ 
able but have some causal ambiguity. It also 
might be that the studies that exist do not 
specifically examine the outcomes of interest 
in the practice guide, although the studies 
may be related to the recommendation. 

A rating of minimal evidence suggests that the 
panel cannot point to a body of evidence that 
demonstrates the practice’s positive effect 


on student achievement. In some cases, this 
simply means that the recommended prac¬ 
tices would be difficult to study in a rigorous, 
experimental fashion; 147 in other cases, it 
means that researchers have not yet studied 
this practice, or that there is weak or con¬ 
flicting evidence of effectiveness. A minimal 
evidence rating does not indicate that the 
recommendation is any less important than 
other recommendations with a strong or 
moderate evidence rating. 

In developing the levels of evidence, the 
panel considers each of the criteria in Table 
A.l. The level of evidence rating is deter¬ 
mined by the lowest rating achieved for any 
individual criterion. Thus, for a recommenda¬ 
tion to get a strong rating, the research must 
be rated as strong on each criterion. If at 
least one criterion receives a rating of moder¬ 
ate and none receives a rating of minimal, 
then the level of evidence is determined to 
be moderate. If one or more criteria receive a 
rating of minimal, then the level of evidence 
is determined to be minimal. 

The panel relied on WWC group design stan¬ 
dards and WWC pilot regression discontinuity 
standards to assess the quality of evidence 
supporting education programs and prac¬ 
tices. The WWC evaluates evidence for the 
causal validity of instructional programs and 
practices according to WWC group design 
standards. Information about these design 
standards is available at https://whatworks. 
ed.gov. Eligible studies that meet WWC group 
design standards without reservations or 
meet WWC group design standards with 
reservations are indicated by bold text in the 
endnotes and references pages. 

A final note about IES practice guides 

In policy and other arenas, expert panels 
typically try to build a consensus, forging 
statements that all its members endorse. 
Practice guides do more than find common 
ground; they create a list of actionable recom¬ 
mendations. Where research clearly shows 
which practices are effective, the panelists 
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use this evidence to guide their recommenda¬ 
tions. However, in some cases, research does 
not provide a clear indication of what works. 
In these cases, the panelists’ interpretation 
of the existing (but incomplete) evidence 
plays an important role in guiding the recom¬ 
mendations. As a result, it is possible that 
two teams of recognized experts working 
independently to produce a practice guide 
on the same topic would come to very differ¬ 
ent conclusions. Those who use the guides 
should recognize that the recommendations 


represent, in effect, the advice of consultants. 
However, the advice might be better than 
what a school or district could obtain on its 
own. Practice guide authors are nationally 
recognized experts who collectively endorse 
the recommendations, justify their choices 
with supporting evidence, and face rigorous 
independent peer review of their conclusions. 
Schools and districts would likely not find 
such a comprehensive approach when seek¬ 
ing the advice of individual consultants. 

Institute of Education Sciences 


Table A.l. Institute of Education Sciences levels of evidence for What Works Clearinghouse 
practice guides 


Criteria 

STRONG Evidence Base 

MODERATE Evidence Base 

MINIMAL Evidence Base 

Validity 

High internal validity (high-quality 
causal designs). Studies must meet 
WWC design standards with or 
without reservations .' 48 

AND 

High internal validity but moderate 
external validity (i.e., studies that 
support strong causal conclusions, 
but generalization is uncertain). 

OR 

The research may include evidence 
from studies that do not meet the 
criteria for moderate or strong evi¬ 
dence (for example, case studies, 
qualitative research). 


High external validity (requires 
multiple studies with high-quality 
causal designs that represent the 
population on which the recom¬ 
mendation is focused). Studies 
must meet WWC design standards 
with or without reservations. 

High external validity but moderate 
internal validity (i.e., studies that 
support the generality of a relation, 
but the causality is uncertain ).' 49 


Effects on 
relevant 

outcomes 

Consistent positive effects without 
contradictory evidence (i.e., no 
statistically significant negative 
effects) in studies with high inter¬ 
nal validity. 

A preponderance of evidence of 
positive effects. Contradictory 
evidence (i.e., statistically sig¬ 
nificant negative effects) must be 
discussed by the panel and con¬ 
sidered with regard to relevance 
to the scope of the guide and 
intensity of the recommendation 
as a component of the intervention 
evaluated. 

There may be weak or contradic¬ 
tory evidence of effects. 

Relevance to 
scope 

Direct relevance to scope (i.e., eco¬ 
logical validity)—relevant context 
(for example, classroom vs. labo¬ 
ratory), sample (for example, age 
and characteristics), and outcomes 
evaluated. 

Relevance to scope (ecological 
validity) mav varv. includina rel- 
evant context (for example, class¬ 
room vs. laboratory), sample (for 
example, age and characteristics), 
and outcomes evaluated. At least 
some research is directly relevant 
to scope (but the research that is 
relevant to scope does not qualify 
as strong with respect to validity). 

The research may be out of the 
scope of the practice guide. 

Relation¬ 
ship between 
research and 
recommenda¬ 
tions 

Direct test of the recommendation 
in the studies or the recommenda¬ 
tion is a major component of the 
intervention tested in the studies. 

Intensity of the recommendation 
as a component of the interven¬ 
tions evaluated in the studies mav 
vary. 

Studies for which the intensity of 
the recommendation as a compo¬ 
nent of the interventions evaluated 
in the studies is low; and/or the 
recommendation reflects expert 
opinion based on reasonable 
extrapolations from research. 


(continued) 
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Table A.l. Institute of Education Sciences levels of evidence for What Works Clearinghouse 
practice guides (continued) 


Criteria 

STRONG Evidence Base 

MODERATE Evidence Base 

MINIMAL Evidence Base 

Panel 

confidence 

The panel has a high degree of con¬ 
fidence that this practice is effective. 

The panel determines that the 
research does not rise to the level 
of strong but is more compelling 
than a minimal level of evidence. 

The panel may not be confident 
about whether the research has 
effectively controlled for other 
explanations or whether the prac¬ 
tice would be effective in most or 
all contexts. 

In the panel's opinion, the recom¬ 
mendation must be addressed as 
part of the practice guide; how¬ 
ever, the panel cannot point to a 
body of research that rises to the 
level of moderate or strong. 

Role of expert 
opinion 

Not applicable 

Not applicable 

Expert opinion based on defen¬ 
sible interpretations of theory 
(theories). (In some cases, this sim¬ 
ply means that the recommended 
practices would be difficult to 
study in a rigorous, experimental 
fashion; in other cases, it means 
that researchers have not yet stud¬ 
ied this practice.) 

When assess¬ 
ment is the 
focus of the 
recommenda¬ 
tion 

For assessments, meets the stan¬ 
dards of The Standards for Educa¬ 
tional and Psychological Testing .' 50 

For assessments, evidence of reli¬ 
ability that meets The Standards 
for Educational and Psychological 
Testing but with evidence of valid¬ 
ity from samples not adequately 
representative of the population 
on which the recommendation is 
focused. 

Not applicable 
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Rationale for Evidence Ratings 151 

The level of evidence assigned to each recommendation is based on the findings of eligible studies 
that examined the effectiveness of recommended practices and meet What Works Clearinghouse 
(WWC) group design standards. 152 The studies were primarily identified through a keyword search 
of several databases. The search focused on studies that were made publicly available between 
January 1987 and January 2016 that examined practices aimed at dropout prevention. It captured 
published and unpublished research literature. This search was supplemented with additional 
studies recommended by the panel. 

The search and panelists identified 1,829 unique studies (see Figure D.l). These studies were then 
screened using eligibility requirements described in the protocol. For example, the study had to 
be publically available, use an eligible design, and examine students in secondary schools. A total 
of 70 studies met protocol requirements and tested interventions that are related to one or more 
recommendations. These studies were reviewed using WWC group design standards or WWC pilot 
regression discontinuity standards, and 25 studies meet standards with or without reservations. 


Figure D.l. Flow diagram for study 
identification, screening, eligibility, 
and inclusion status/ratings 



For this practice guide, study findings are 
classified as having a positive or negative 
effect when the findings are either: 


Findings that met neither criteria are classified 
as “indeterminate effects.” 

As described in the introduction to this guide, 
the panel and practice guide staff assigned 
a level of evidence to each recommendation 
after examining the entire body of evidence 
supporting each recommendation. In par¬ 
ticular, the level of evidence assigned to each 
recommendation was based on the consis¬ 
tency of effects, the strength of relationship 
between the evidence and the recommenda¬ 
tion, and the internal and external validity 
of each study. The magnitude of the effects 
and the sample sizes of each individual study 
were not considered. 

Some studies met WWC group design stan¬ 
dards but did not adjust statistical signifi¬ 
cance when there were multiple comparisons 
within an outcome domain or when the unit 
of assignment was different from the unit of 
analysis (“clustering”). For example, a study 
may assign classrooms to intervention and 
comparison conditions but analyze individual 
student test scores. In these cases, the WWC 
adjusted for clustering and multiple compari¬ 
sons within a domain. 155 


statistically significant (p < 0.05), 153 or 

substantively important as defined by the 
WWC. 154 
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school-affiliated programs that serve stu¬ 
dents at risk for dropping out of school. To 
be eligible for review, a study must involve 
students currently enrolled in school. Thir¬ 
teen studies examined interventions deliv¬ 
ered to subgroups of at-risk students within 
a school, 156 and one study examined an 
intervention delivered to all Hispanic stu¬ 
dents within a school. 157 Nine studies exam¬ 
ined interventions delivered to all students 
in a grade or school, regardless of individual 
students’ risk for dropping out. 158 In these 
studies, the sample schools serve primarily 
at-risk students. The final two studies exam¬ 
ined alternative schools specifically designed 
for at-risk students. 159 

Eligible outcomes. The study outcomes 
were classified into three primary domains 
related to dropout prevention (see Table D.l). 
Outcomes in the staying in school domain 
include measures of enrollment in school. 
Outcomes in the progressing in school 
domain indicate whether students are com¬ 
pleting required courses and advancing to 
the next grade on schedule. Measures in this 
domain are particularly useful for identify¬ 
ing students who are still enrolled but are 
falling behind and may be at risk for future 
dropout. Outcomes in the graduating school 
domain include measures of graduation with 
a high school diploma. In some cases, gradu¬ 
ation outcomes may measure graduation 
from a specific school or district, rather than 
graduation from any school. 160 A positive 
effect always indicates that the intervention 
group outperformed the comparison group 
for a particular outcome. 

While this appendix describes the full body 
of evidence reviewed for this guide on stay¬ 
ing in school, progressing in school, and 
graduating school, when possible the guide 
highlights the effects that recommended 
practices have on graduation. This focus was 
chosen because the panel determined that 
graduation should be the ultimate objective 
of dropout prevention efforts, as earning 
a high school diploma is more consistently 
correlated with success in postsecondary 


education and in the labor market than leav¬ 
ing high school without a diploma. 161 If there 
is conflicting evidence for different types 
of outcomes—for example, an intervention 
has positive effects on staying in school in 
the short term but indeterminate effects on 
graduation—the findings on graduation are 
weighted more heavily in determining the 
level of evidence for the recommendation. 
The panel does not want to recommend 
practices that are only effective at keeping 
students in school in the short term but not 
at eventually helping them to graduate. 

Seven studies that include eligible outcome 
measures in the progressing in school, stay¬ 
ing in school, or graduating school domains 
also reported additional outcomes of interest 
related to school completion, postsecondary 
education, and labor-market participation (see 
Table D.l). 162 These outcomes do not contrib¬ 
ute to the levels of evidence for recommenda¬ 
tions. However, the panel determined that 
they might be affected by dropout prevention 
practices and be of interest to educators and 
practitioners who are implementing these 
practices. These outcomes are presented in 
Tables D.2-D.5 in italicized gray font. 

Many of the eligible outcomes can be reported 
at different time points. The tables in this 
appendix report progressing in school and stay¬ 
ing in school outcomes that have the longest 
timeframes, as the ultimate goal of reducing 
dropout is high school graduation. For example, 
a multi-year study may report persistence 
after 1 year and after 2 years. In this case, the 
tables report persistence after 2 years. Eligible 
outcomes measured at other points in time are 
presented in the table notes. 163 

Graduation can also be measured at different 
time points (e.g., 4 or 6 years after 9th-grade 
enrollment). The tables report graduation 
at 4 years after 9th-grade enrollment, when 
available, because this is the most commonly 
reported timeframe for graduation outcomes 
across studies in this guide. 164 If a study does 
not report 4-year graduation but does report 
graduation at another point in time, the 
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Table D.l. Description of outcome domains 


Outcome Domain 

Sample Outcomes 

Dropout prevention outcome domains 

Staying in school 

■ number of days enrolled in school 

■ whether student dropped out of school 

Progressing in school 

■ number of high school course credits earned 

■ promotion to the next grade 

■ highest grade student completed 

Graduating school 

■ graduation with a high school diploma 

Additional outcome domains of interest 

Completing school 

■ completing school with a CED or a high school diploma 

Postsecondary access and enrollment 

■ enrollment in college 

■ intensity of enrollment (full- or part-time) 

Postsecondary credit accumulation and persistence 

■ number of college-level credits earned 

■ number of terms of continuous enrollment 

Postsecondary attainment 

■ completion of degree, certificate, or program 

Labor market 

■ employment after high school completion 

■ income earned after high school completion 


tables report the graduation outcome closest 
to 4 years after 9th-grade enrollment. 

For studies that report multiple outcome 
measures within a domain, the tables in this 
appendix report the overall average effect 
size for all measures in the domain meeting 
WWC group design standards. 

Course grades are not an eligible outcome, 165 
but some measures that are eligible in the 
progressing in school domain are based on 
multiple course grades (e.g., credits earned 
and grade promotion). 166 Attendance and 
behavior are not eligible outcomes, although 
they are sometimes correlated with dropout 
and with other eligible outcome measures. 

Interventions including components 
from multiple recommendations. Some 
study interventions included multiple prac¬ 
tices related to more than one recommenda¬ 
tion (multi-component interventions or 
bundled interventions). For example, the 
Early College High Schools intervention 
includes tracking student progress and inter¬ 
vening when students are offtrack (Recom¬ 
mendation 1), building personal relationships 
and incorporating college-readiness initiatives 


(Recommendation 3), and creating small, 
autonomous schools located on college cam¬ 
puses (Recommendation 4). 167 Any component 
of this intervention—and thus the relevant 
practices corresponding to any of these recom¬ 
mendations—could have caused the reported 
effects in the study. The effects might have 
also been caused by interactions between the 
practices from two or more recommendations. 

The panel and staff considered the degree of 
bundling as one factor when determining the 
level of evidence. For studies of interventions 
with multiple components, the panel and staff 
considered whether all of the implemented 
practices could have plausibly affected drop¬ 
out prevention outcomes, and which of the 
practices were critical to the intervention. The 
following factors affected how these studies 
contributed to the level of evidence: 

■ The study could support a strong level 
of evidence for a recommendation if the 
recommendation’s practices were consid¬ 
ered by the panel as a critical part of the 
intervention (i.e., the intervention would 
have been fundamentally different without 
the recommendation’s practices). 
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■ The study could support a moderate 
level of evidence for a recommendation 
if the recommendation’s practices could 
have plausibly affected outcomes but 
the recommendation’s practices were not 
considered by the panel as a critical part 
of the intervention. 


Recommendation 1. Monitor the 
progress of all students, and proactively 
intervene when students show early 
signs of attendance, behavior, or 
academic problems. 

Level of evidence: Minimal Evidence 

WWC staff and the panel assigned a minimal 
level of evidence based on five studies that 
meet WWC group design standards without 
reservations 168 and one study that meets WWC 
pilot regression discontinuity standards with 
reservations 169 (see Table D.2). Two of these 
studies reported positive effects on outcomes 
in at least one of the three primary outcome 
domains, 170 and two of the three studies 
that examined outcomes in the graduating 
school domain found positive effects on high 
school graduation. 171 One of the two studies 
that found positive effects evaluate inter¬ 
ventions that include components of other 
recommendations, so the effects cannot be 
attributed solely to practices related to this 
recommendation; 172 only one study tests the 
recommended practices without components 
of other recommendations, but this study 
only examines two of the four recommended 
steps. 173 The absence of a direct test of the 
full recommendation means the relationship 
between the supporting research and recom¬ 
mended practices is low, leading to a minimal 
level of evidence. 

Consistency of effects on relevant 
outcomes 

Graduating school. The studies related to 
this recommendation demonstrated a mix 
of positive and indeterminate effects in the 
graduating school domain. Three studies 


supporting this recommendation examined 
graduation outcomes, 174 and two found posi¬ 
tive effects. 175 

Staying in school. The studies supporting 
this recommendation found a mix of positive 
and indeterminate effects on outcomes in 
the staying in school domain. Five studies 
examined outcomes in the staying in school 
domain, one of which found positive effects 176 
and four of which found indeterminate effects. 177 
One study that found indeterminate effects 
examined an intervention that was a “low- 
intensity program,” according to the authors. 
In this study, the comparison group students 
also had access to similar services (such as 
counseling and academic tutoring support) 
as the intervention group. 178 

Progressing in school. The two studies that 
examined outcomes in the progressing in 
school domain found indeterminate effects. 179 
One of the studies that reported indeterminate 
effects across all outcomes in this domain did 
find statistically significant positive effects 
for some cohorts and outcomes within 
the domain. 180 The other study is the “low- 
intensity program” described above as having 
indeterminate effects on staying in school. 181 

Details about the supporting evidence 
(studies that demonstrate positive 
effects) 

The remaining paragraphs in this section 
describe the two studies that found positive 
effects in at least one outcome domain (i.e., 
the studies that contribute to the minimal 
level of evidence). 182 

Internal validity of supporting evidence. 

The studies supporting this recommenda¬ 
tion have strong internal validity. One was a 
randomized controlled trial (RCT) with low 
sample attrition that meet WWC group design 
standards without reservations. 183 The other 
study was a regression discontinuity design 
that meets WWC pilot regression discontinuity 
standards with reservations for its reduced- 
form (intent-to-treat) estimates. 184 
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Relationship between the evidence and 
Recommendation 1. Only one study exam¬ 
ined the recommended practices without other 
intervention components, providing a direct 
test of the recommendation. 185 None of the 
studies tests all four steps of the recommenda¬ 
tion or explicitly tests Steps B or 4. One study 
examines interventions that relate to Steps 1 
and 2 (using data to identify students who are 
falling offtrack and intervene to help them). 186 
The other study examines an intervention 
that is aligned with Step 2 (intervening with 
students who show signs of falling offtrack) 
but is only partially aligned with Step 1 (using 
teachers to informally track student progress 
and intervene as needed, which is somewhat 
different than the systematic tracking that 
Step 1 describes). 187 


External validity of supporting evidence. 

Both studies compared the recommended 
practices to regular classes and activities 
in traditional high schools. The length and 
intensity of the interventions varied, ranging 
from 45-minute daily sessions to practices 
integrated throughout the school day for 4 or 
5 years. The grade levels in which the inter¬ 
ventions were implemented spanned from 
9th grade through high school completion and 
beyond. 188 One study took place in Chicago 
and had a sample population of nearly all 
black and Hispanic students with high levels 
of poverty (measured by the percentage of 
students participating in the free or reduced- 
price lunch program). 189 The other study was 
conducted in North Carolina, with a sample 
that was one-third minority, and with less than 
one-half qualified for free or reduced-price 
lunch. 190 Collectively, the studies demonstrate 
limited generalizability. 


Table D.2. Studies providing evidence for Recommendation 1 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Meets WWC Croup Design Standards Without Reservations 

Corrin et 
al. (2016)“ 

Randomized 

controlled 

trial 

30,230 

6th- and 

9th-grade 

students 

59 schools 

across 

11 urban 
school 
districts in 
the United 
States 

Students participated in Diplomas Now , a 
schoolwide, multi-year intervention that 
included teacher teams and small learning com¬ 
munities, a college-readiness curriculum, coach¬ 
ing and professional development for teachers, 
tiered student support (early warning systems, 
academic and mentoring support, and case 
management), integrated on-site support (site 
coordinator, transformation facilitator, etc.), 
family and community involvement, and pro¬ 
gram staff training and development. 

Students partici¬ 
pated in regular 
classes and 
activities. 

Progress¬ 
ing in school 
(cohort 1) = 
0.05 b ' c 

Dynarski et 
al. (1998) 
(Long Beach 
Up With 
Literacy ) 

Randomized 

controlled 

trial 

97 middle 

school 

students 

6 middle 
schools in 
Long Beach, 
California 

Students participated in the Up with Literacy 
dropout prevention program that provided in- 
class and after-school tutoring and homework 
help along with enrichment activities. Service 
elements of the program included counseling, 
attendance monitoring, outreach to families, 
and accelerated learning. 

Students partici¬ 
pated in regular 
classes and 
activities. 

Staying 
in school 
(cohort 1) 

= 0 d 
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Table D.2. Studies providing evidence for Recommendation 1 (continued) 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Edmunds et 
al. (2015) e f 

Randomized 

controlled 

trial 

1,594 high 
school 
students in 
grades 9-12 
or 9-13 

12 Early 
College High 
Schools 
in North 
Carolina 

Students attended North Carolina Early College 
High Schools , which partnered with higher- 
education institutions and offered curricula 
that allowed students to complete both high 
school and associate’s degrees simultaneously. 
The schools focused on college readiness, 
high-quality teaching and learning, personal 
relationships between students and staff, high 
expectations, and staff commitment to a shared 
mission. Early College High Schools are small, 
autonomous schools that serve grades 9-12 
or 9-13 (4 or 5 years). Teachers monitored 
students’ progress and actively intervened to 
provide extra assistance when students’ grades 
dropped or they fell off track. 

Students partici¬ 
pated in regular 
classes and 
activities. 

Staying in 
school = 

0.40* 9 

Graduating 
school = 

0.16* h 

Heller et al. 
(2013) 1 j 

Randomized 

controlled 

trial 

2,740 male 
students in 
grades 7-10 

18 Chicago 
Public 

Schools 
middle and 
high schools 

Students participated in one of three interven¬ 
tion groups of the Becoming a Man (BAM) inter¬ 
vention: an in-school intervention group, an 
after-school intervention group, or both an in¬ 
school and an after-school intervention group. 
Consistent with the study, this practice guide 
combines these three intervention groups. 

The in-school intervention consisted of 27 one- 
hour weekly sessions during the academic 
year. The sessions were offered in place of a 
traditional class during the school day. The 
instructors were college-educated and were not 
required to have specialized training. The cur¬ 
riculum components included elements of cogni¬ 
tive behavioral therapy. 

The after-school intervention consisted of 1- to 
2-hour sessions during the academic year. Each 
session included student participation in non- 
traditional sports and reflection on their behav¬ 
ior. The after-school coaches were trained in 
the intervention. 

Students 
received regu¬ 
lar classroom 
instruction. The 
authors noted 
that there was 
a high level of 
crossover in 
which some of 
the compari¬ 
son students 
received the 
intervention. 

Staying 
in school 
(2010-2011) 

= 0.15 k 

Graduating 
school = 

0.19' 

Heller et al. 
(2015) m " 

Randomized 

controlled 

trial 

2,064 male 
9th- and 
lOth-grade 
students 

9 Chicago 
Public 

Schools 
high schools 

Students participated in the Becoming a Man 
(BAM) program, which consisted of weekly 

1-hour group sessions for 2 years. The sessions 
were led by “counselors,” college-educated men 
hired and trained to deliver the established cur¬ 
riculum. The sessions used cognitive behavioral 
therapy and included reflection, role-playing, 
skill-building, and stories and discussion. Over 
the 2-year program, students voluntarily partic¬ 
ipated in up to 45 sessions. The sessions took 
place during the school day, and the students 
missed class to attend the program. In addition, 
after-school sports programming was offered 
in 5 of the 9 schools during the first year only. 

Students partici¬ 
pated in regular 
classes and 
school activities. 

Staying in 
school = 

0.11° 
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Table D.2. Studies providing evidence for Recommendation 1 (continued) 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Meets WWC Croup Design Standards With Reservations 

Cortes, 
Goodman, 
and Nomi 
(2015) p 

Regression 

discontinuity 

design 

9,700 

9th-grade 

students 

73 Chicago 
Public 

Schools 
high schools 

Students assigned to double-dose algebra 
received 90 minutes of math class every day for 
a full academic year. The first math course, reg¬ 
ular algebra, consisted mostly of class lectures. 
The second math course, algebra with support 
or algebra problem-solving, focused on build¬ 
ing math skills that students lacked. For most 
students, the second period of algebra replaced 
an optional class, such as music or art. 

Teachers of double-dose algebra received two 
curricula called Agile Mind and Cognitive Tutor ; 
standalone lesson plans, and three professional 
development workshops on using extra instruc¬ 
tional time. 

Students took 
one algebra 
course (45 min¬ 
utes of daily 
instruction) dur¬ 
ing the school 
year. 

Staying in 
school (~) 9 

Progressing 
in school (+) r 

Graduating 
school (+) s 

Postsecond¬ 
ary enroll¬ 
ment (+*)’ 


Notes: 

All studies in this table meet WWC group design standards with or without reservations. Within each rating section, studies are listed 
alphabetically by first author. 

Each row in this table represents a study, defined by the WWC as an examination of the effect of an intervention on a distinct sample. 

In some cases, multiple contrasts or studies were described in a single article. In these cases, the contrast or study that is most rel¬ 
evant to the recommendation is included in the table. 

For studies that included multiple outcomes in a domain, reported effect sizes and statistical significance are for the domain and 
calculated as described in the WWC Procedures and Standards Handbook 3.0 (pp. 25-26). 

Several studies examined the dropout rate, which falls under the staying in school domain. These effect sizes were reported as nega¬ 
tive in the studies. In this table, the signs of the effect sizes for staying in school are reversed for clarity. A plus sign (+) indicates that 
the intervention had a positive effect on staying in school (or a reduced dropout rate), meaning the intervention group had a higher 
rate of staying in school than the comparison group. 

Italicized gray font is used for outcome domains (e.g., postsecondary enrollment) that are not directly related to dropout prevention 
and do not contribute to the level of evidence of this recommendation, but might be affected by dropout prevention practices and be 
of interest to educators and practitioners who are implementing these practices. 

* = statistically significant at the 0.05 level 
~ = indeterminate effects 

“This study is also used as evidence for Recommendation 2. 

b The panel determined that the outcome “percentage of students who had no core course failures during the year” in the progressing 
in school domain was the most relevant to this guide. This is the only outcome included in this domain. The study also reports “per¬ 
centage of core courses passed,” “percentage of students who had no math course failures during the year,” “percentage of students 
who had no ELA course failures during the year,” “percentage of students above the stability threshold,” and “percentage of students 
with no early warning indicators” in the progressing in school domain. 

c The WWC-calculated effect size for the cohort 2 progressing in school outcome was 0.02 and not statistically significant. 

d The “highest grade completed," an outcome in the progressing in school domain, was also examined and meets standards, but the 
study does not provide sufficient information to assess the magnitude or significance of effects. 

e This study is also used as evidence for Recommendations B and 4. 

f The review of this study incorporates data from Edmunds et al. (2011). The review also includes implementation information about 
the Early College High School intervention from Edmunds et al. (2010). In particular, Edmunds et al. (2010) describes how teachers 
actively monitored students and intervened when they fell off track, which aligns with Recommendation 1. This monitoring compo¬ 
nent of the intervention was not described in another study of the Early College High School initiative which met WWC group design 
standards, Berger et al. (2013), and therefore, that study does not support Recommendation 1. None of the outcomes in Edmunds 
et al. (2010) meet eligibility requirements. 

9 The staying in school outcome reported in this table is from Edmunds et al. (2011). The sample consisted of 718 students from 
19 Early College High Schools. This sample overlaps with the sample included in Edmunds et al. (2015). 

h Five-year graduation rate. 

1 This study is also used as evidence for Recommendation 3. 
j The review of this study included data from Study 1 in Heller et al. (2015). 

k The reported effect is the complier average causal effect (CACE) effect. The intent-to-treat (ITT) effect size is 0.06 and not statistically 
significant. The study also reported enrollment status, which falls under the staying in school domain, for the 2009/10 school year. 

The CACE effect was 0.27 and not statistically significant, and the ITT effect was 0.10 and not statistically significant. 

1 Four-year (“on-time”) graduation rate. The reported effect is the complier average causal effect (CACE) effect. The intent-to-treat 
(ITT) effect size is 0.08 and not statistically significant. The study also reports two other graduating school outcomes: graduating 
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high school by the 2014/15 school year, 4-7 years after starting 9th grade (CACE estimate is 0.14 and not statistically significant; ITT 
estimate is 0.06 and not statistically significant), and graduating school with transfers counted as graduates (CACE estimate is 0.22 and 
statistically significant; ITT estimate is 0.09 and statistically significant). 

m This study is also used as evidence for Recommendation 3. 

n The review of this study included only Study 2. Study I was reviewed in conjunction with Heller et al. (2013), and Study 3 is 
ineligible. 

0 The reported effect is the compiler average causal effect (CACE) effect in in year 2. The intent-to-treat (ITT) effect size in year 2 is 
0.06 and not statistically significant. The ITT and CACE effect sizes for staying in school in year 1 are 0.03 and 0.06, respectively, and 
not statistically significant. 

p The reduced-form estimates, which are not reported in the study, meet standards with reservations. Although we do not know the 
magnitude of the reduced-form estimates, we know the direction of effects (positive or negative) and whether or not they are signifi¬ 
cant at the 0.05 level. 

q The study examined three outcome measures in the staying in school domain, two of which were positive and not significant, and 
one of which was negative and not significant. 

r The study examined four outcome measures in the progressing in school domain, one of which was positive and significant, and 
three of which were positive and not significant. 

s The study examined 4-year and 5-year graduation rates in the graduating school outcomes; the 4-year graduation rate was positive 
and not significant, and the 5-year rate was positive and significant. 

’ The study examined three outcome measures in the postsecondary access and enrollment domain, all which were positive and 
significant. 


Recommendation 2. Provide intensive, 
individualized support to students who 
have fallen off track and face significant 
challenges to success. 

Level of evidence: Moderate Evidence 

WWC staff and the panel assigned a moder¬ 
ate level of evidence based on eight studies 
that meet WWC group design standards 
without reservations (see Table D.3). 191 Four 
of these studies reported positive effects for 
outcomes in at least one of the three primary 
outcome domains, 192 and two of the three 
studies that examined outcomes in the grad¬ 
uating school domain found positive effects 
on high school graduation. 193 Two of the four 
studies that found positive effects evaluate 
interventions that are closely aligned with all 
of the recommendation’s steps and do not 
include components of other recommenda¬ 
tions; these studies provide a direct test of 
the recommendation. 194 The strong internal 
and external validity of supporting studies, 
and the preponderance of positive effects 
among studies that provide a direct test of 
the recommendation, indicate a moderate 
level of evidence. 


Consistency of effects on relevant 
outcomes 

Graduating school. The studies related to 
this recommendation demonstrated consistent 
positive effects in the graduating school domain. 
Two of the three studies that examined out¬ 
comes in this domain found positive effects. 195 

Staying in school. The studies supporting 
the recommendation found both positive and 
indeterminate effects in the domains of stay¬ 
ing in school and progressing in school. No 
negative effects were found in either domain. 
Two studies found positive effects on out¬ 
comes in the staying in school domain, 196 while 
two studies found indeterminate effects in 
this domain. 197 One of the studies that found 
indeterminate effects on staying in school also 
found positive effects on graduation. 198 The 
other study that found indeterminate effects 
on the longest-term measure of staying in 
school found positive effects on measures 
of staying in school with shorter-term obser¬ 
vation periods (this study did not examine 
outcomes in the graduating school domain). 199 

Progressing in school. One study found 
positive effects in the progressing in school 
domain, 200 and two studies found indeter¬ 
minate effects in this domain. 201 One of the 
studies that reported indeterminate overall 
effects in the progressing in school domain 
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did find positive effects for some cohorts 
and outcomes. 202 The other study that found 
indeterminate effects examined an interven¬ 
tion that the panel believes did not provide 
sufficient support to students (an average of 
16 contact hours). 203 

Details about the supporting evidence 
(studies that demonstrate positive 
effects) 

The remaining paragraphs in this section 
describe the four studies that found positive 
effects in at least one domain (i.e., the studies 
that contribute to the moderate level of 
evidence). 

Internal validity of supporting evidence. 

The studies supporting this recommendation 
have strong internal validity. All four studies 
were RCTs with low sample attrition that 
meet WWC group design standards without 
reservations. 204 


Relationship between the evidence and 
Recommendation 2. The studies support¬ 
ing this recommendation examine interven¬ 
tions that are closely aligned with all steps of 
Recommendation 2. Two of the four studies 
examine interventions that do not include 
other intervention components and provide a 
direct test of the recommendation. 205 

External validity of supporting evidence. 

The four studies supporting this recommenda¬ 
tion compared the recommended practices to 
regular classes and activities in traditional high 
schools. The study participants were students 
who were identified as at risk for dropping 
out. In all five studies, the majority of students 
are racial/ethnic minorities and are from dis¬ 
tricts across the United States. The length and 
intensity of the interventions varied, ranging 
from 1 year to 5 years, with up to 750 con¬ 
tact hours each year for 5 years. The studies 
included participants in grades 7-12, either in 
middle school or high school settings. 


Table D.3. Studies providing evidence for Recommendation 2 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Meets WWC Croup Design Standards Without Reservations 

Corrin et 
al. (2015) 

Randomized 

controlled 

trial 

2,048 
students 
in middle 
and high 
school 

28 Title 1 
middle and 
high schools 
in North 
Carolina, 
South 
Carolina, 
and Texas 

Students received individualized support ser¬ 
vices from Communities in Schools site coor¬ 
dinators. Student services fell under eight 
categories: academic, behavioral, attendance, 
social/life skills, basic needs/resources, college/ 
career preparation, enrichment/motivation, and 
family related. Students were assessed annually 
to determine the intensity and duration of their 
case management. On average, students were 
enrolled in case management for 30 weeks and 
received 19.4 service contacts and 16.2 service 
hours during the year. 

Students had 
access to the 
regular student 
support avail¬ 
able in their 
schools, which 
varied widely 
across schools. 

Progressing 
in school = 
-0.06 

Corrin et 
al. (2016) a 

Randomized 

controlled 

trial 

30,230 

6th- and 

9th-grade 

students 

59 schools 

across 

11 urban 
school 
districts in 
the United 
States 

Students participated in Diplomas Now , a 
schoolwide, multi-year intervention that 
included teacher teams and small learning com¬ 
munities, a college-readiness curriculum, coach¬ 
ing and professional development for teachers, 
tiered student support (early warning systems, 
academic and mentoring support, and case 
management), integrated on-site support (site 
coordinator, transformation facilitator, etc.), 
family and community involvement, and pro¬ 
gram staff training and development. 

Students partici¬ 
pated in regular 
classes and 
activities. 

Progressing 
in school 
(cohort 1) = 
0.05 b ' c 
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Table D.3. Studies providing evidence for Recommendation 2 (continued) 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Dynarski et 
al. (1998) 
(Boston 

JFY High 
School) 11 

Randomized 

controlled 

trial 

212 high 

school 

students 

3 alternative 
high schools 
in Boston, 
Massachu¬ 
setts 

Students attended alternative high schools 
that provided a competency-based curriculum 
and enhanced social services, including career 
awareness, accelerated learning, and counsel¬ 
ing services. Students received individualized 
course schedules tailored to their needs, flex¬ 
ible schedules, and childcare. The schools were 
smaller than typical urban high schools and in a 
separate facility from other high schools in the 
district. 

Students par¬ 
ticipated in 
regular classes 
and activities at 
traditional high 
schools. 

Staying 
in school 
(cohort 1, 
year 2) = 

-0.17 

Graduating 
school 
(cohort 1, 
year 2) = 

0.25 e 

Completing 
school (GED 
only, cohort 

1, year 2) = 
-0.09 

Dynarski et 
al. (1998) 
(Las Vegas 
Horizon 
High 
Schools) 1, 

Randomized 

controlled 

trial 

399 9th- and 

lOth-grade 

students 

4 alternative 
high schools 
in Las Vegas, 
Nevada 

The students attended alternative high schools, 
which offered individualized academic plans for 
each student. Students participated in coop¬ 
erative learning, small-group instruction, and 
hands-on experiences. They also received sup¬ 
port services and childcare as needed. 

Students par¬ 
ticipated in 
regular classes 
and activities at 
traditional high 
schools. 

Staying 
in school 
(cohort 1, 
year 3) = 

0.259 

Graduating 
school 
(cohort 1, 
year 3) = 

0.95 h '' 

Completing 
school (CED 
only, cohort 

1, year 3) = 
-0.i2 

Larson and 
Rumberger 
(1995) k 

Randomized 

controlled 

trial 

94 Mexican- 
American 
junior high 
school 
students 
in grades 

7 to 9' 

Los Angeles, 
California 

Students participated in the Achievement for 
Latinos through Academic Success (ALAS) 
program, a multi-pronged intervention that 
focused on Latino adolescents. School and pro¬ 
gram staff implemented the intervention, which 
lasted for all 3 years of junior high school 
(grades 7-9). Students participated in social 
metacognitive problem-solving training, coun¬ 
seling, recognition and bonding activities, and 
enhancement of school affiliation. The school 
monitored student attendance and provided 
frequent feedback to students and parents. The 
parents were trained in parent-child problem¬ 
solving and school participation. Community 
agencies for youth and family services also par¬ 
ticipated in the program. 

Students partici¬ 
pated in the reg¬ 
ular junior high 
school program. 

Staying in 
school (end 
of 11th grade) 
= 0.24 m 
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Table D.3. Studies providing evidence for Recommendation 2 (continued) 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Rodriguez- 

Planas 

(2012)" 

Randomized 

controlled 

trial 

1,008 high 

school 

students 

11 schools 
across 7 
locations in 
the United 
States: 
Cleveland, 
Ohio; Wash¬ 
ington, DC; 
Fort Worth, 
Texas; 
Houston, 
Texas; 
Memphis, 
Tennessee; 
Philadelphia, 
Pennsylvania; 
and Yakima, 
Washington 

Students in the Quantum Opportunity Program 
(QOP) received a range of social, academic, and 
employment supports. Students participated in 
up to 750 hours of activities after school and on 
weekends each year for 5 years. (Students who 
graduated high school in 4 years received men¬ 
toring and assistance with college enrollment 
during the fifth year.) Program activities included 
anger-management and family-planning discus¬ 
sions, academic tutoring and planning, community 
service, and pre-employment training. Students 
were also offered financial incentives to actively 
participate in the program. 

Students partici¬ 
pated in regular 
classes and 
school activities. 
Some of the 
comparison 
group students 
attended the 
same schools 
as QOP 
participants. 

Graduating 
school (late 
teens) = 0.13° 

Completing 
school (late 
teens) = -0.08 p 

Postsecondary 
access and 
enrollment 
(mid-2 Os) = 
0.15« 

Postsecondary 

credit 

accumulation 
(mid-20s) = (+)’ 

Postsecondary 
attainment 
(mid-20s) = 

0.12 s 

Labor market 
(mid-20s) = (-} 

Sinclair et 
al. (1998) 

Randomized 

controlled 

trial 

92 9th grade 
students 

Urban 
school 
district in 
the northern 
Midwest 
United 

States 

Students in the Check & Connect program 
had their attendance, behavior, and academic 
performance monitored on a daily basis. Par¬ 
ticipants were also assigned a "monitor” who 
functioned as a mentor and case worker and 
stayed with the student even if he or she trans¬ 
ferred to another school within the district. 
Monitors intervened with the student as soon 
as an attendance, performance, or behav¬ 
ior problem arose and worked with them to 
address the underlying causes. The interven¬ 
tion lasted 1 school year (9th grade). 

Students 
received Check 
& Connect ser¬ 
vices in 7th and 
8th grade, but 
stopped receiv¬ 
ing them when 
they entered 9th 
grade. 

Progressing 
in school = 
0.83* 

Sinclair, 
Christen¬ 
son, and 
Thurlow 
(2005) 

Randomized 

controlled 

trial 

144 high 

school 

students 

7 schools 
in 1 school 
district in 
Minneapolis, 
Minnesota 

Students in the Check & Connect program had 
their attendance, behavior, and academic per¬ 
formance monitored on a regular basis. Each 
participant was also assigned a “monitor” who 
functioned as a mentor and case worker and 
stayed with the student even if he or she trans¬ 
ferred to another school within the district. 
Monitors intervened with the students as soon 
as an attendance, performance, or behav¬ 
ior problem arose and worked with them to 
address the underlying causes. Participating 
students kept the same monitor throughout 
their high school career. 

Students partici¬ 
pated in regular 
classes and 
activities and 
did not receive 
Check & Connect 
services. 

Staying in 
school = 

0.46* u 

Completing 
school = 0.03 


Notes: 

All studies in this table meet WWC group design standards without reservations. Within each rating section, studies are listed alphabeti¬ 
cally by first author. 

Each row in this table represents a study, defined by the WWC as an examination of the effect of an intervention on a distinct sample. 

In some cases, multiple contrasts or studies were described in a single article. In these cases, the contrast or study that is most relevant 
to the recommendation is included in the table. 

For studies that included multiple outcomes in a domain, reported effect sizes and statistical significance are for the domain and calcu¬ 
lated as described in the WWC Procedures and Standards Handbook 3.0 (pp. 25-26). 

Several studies examined the dropout rate, which falls under the staying in school domain. These effect sizes were reported as nega¬ 
tive in the studies. In this table, the signs of the effect sizes for staying in school are reversed for clarity. A plus sign (+) indicates that 
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the intervention had a positive effect on staying in school (or a reduced dropout rate), meaning the intervention group had a higher 
rate of staying in school than the comparison group. 

Italicized gray font is used for outcome domains (e.g., completing school, postsecondary credit accumulation, postsecondary attain¬ 
ment, and labor market participation) that are not directly related to dropout prevention and do not contribute to the level of evidence 
of this recommendation, but might be affected by dropout prevention practices and be of interest to educators and practitioners who 
are implementing these practices. 

* = statistically significant at the 0.05 level 
~ = indeterminate effects 

“This study is also used as evidence for Recommendation 1. 

b The panel determined that the outcome “percentage of students who had no core course failures during the year” in the progressing 
in school domain was the most relevant to this guide. This is the only outcome included in this domain. The study also reports “per¬ 
centage of core courses passed,” “percentage of students who had no math course failures during the year,” “percentage of students 
who had no ELA course failures during the year,” “percentage of students above the stability threshold,” and “percentage of students 
with no early warning indicators” in the progressing in school domain. 

c The WWC-calculated effect size for the cohort 2 progressing in school outcome was 0.02 and not statistically significant. 
d This study is also used as evidence for Recommendations 3 and 4. 

“Graduation rate 2 years after the start of the program; students were 18 years old on average upon entering the program. 
f This study is also used as evidence for Recommendation 4. 

9 The study also reports the dropout rate under the staying in school domain for cohorts 1 and 2 in year 2 of the program: the effect 
was 0.22 and statistically significant. 

h Graduation rate 3 years after the start of the program; students were 15-16 years old upon entering the program. 

'The study also reports the graduation rate under the graduating school domain for cohorts 1 and 2 in year 2 of the program. How¬ 
ever, the WWC cannot calculate an effect size when the mean of one group (in this case, the intervention group) is 0. 

J The study also reports the GED completion rate under the completing school domain for cohorts 1 and 2 in year 2 of the program: the 
effect was 0.43 and not statistically significant. 

k This study was reviewed in conjunction with Rumberger and Larson (1992). 

1 Demographic information is reported only if the intervention was designed for and administered to a specific group of students. 

m The study reported staying in school outcomes for two other time periods: the end of 8th grade (0.79) and the end of 9th grade 
(1.34). Both were statistically significant. 

n This study was reviewed in conjunction with Schirm, Stuart, and McKie (2006). 

0 Graduation rate, based on survey of students in their late teens. This graduation outcome most comparable to the 4-year graduation 
rate reported in other studies. 

p The study examined one outcome measure in the completing school domain, based on a survey of students in their late teens. 

q The study examined two outcome measures in the postsecondary access and enrollment domain, based on a survey of students in 
their mid-twenties. 

' The study examined two outcome measures in the postsecondary credit accumulation domain, based on a survey of students in their 
mid-twenties. The author did not report the effect sizes, and the WWC was able to calculate the effect size for only one of the measures, 
which was 0.19 and statistically significant (the author also reported that this effect was statistically significant). The WWC did not have 
sufficient information to calculate an effect size or assess statistical significance for the other measure in this domain, so could not calcu¬ 
late a domain average. The table indicates that the effect was positive based on the measure that the WWC could calculate. 

s The study examined whether students obtained a bachelor's or associate’s degree in the postsecondary attainment domain, based on 
a survey of students in their mid-twenties. 

’ The study examined four outcome measures in the labor market domain, based on a survey of students in their mid-twenties. The 
author did not report the effect sizes, and the WWC was able to calculate the effect size for only one of the measures, which was 
0.02 and not statistically significant (the author also reported that this effect was not statistically significant). The WWC did not have 
sufficient information to calculate an effect size or assess statistical significance for the other measures in this domain, so could not 
calculate a domain average. The table indicates that the effect was indeterminate based on the measure that the WWC could calculate. 

u The staying in school outcome includes only the cohort dropout rate. The study also reports whether students are still enrolled in year 4 
(the effect was 0.61 and statistically significant) and the 5-year completion rate (the effect was 0.11 and not statistically significant). 
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Recommendation 3. Engage students 
by offering curricula and programs 
that connect schoolwork with college 
and career success and that improve 
students’ capacity to manage challenges 
in and out of school. 

Level of evidence: Strong Evidence 

WWC staff and the panel assigned a strong 
level of evidence based on 11 studies that 
meet WWC group design standards without 
reservations 206 and three studies that meet 
WWC group design standards with reserva¬ 
tions (see Table D.4). 207 Nine of these studies 
reported positive effects for outcomes in 
at least one of the three primary outcome 
domains, 208 and seven of the eight studies 
that examined outcomes in the graduating 
school domain found positive effects on 
high school graduation. 209 Four of the studies 
that found positive effects evaluate interven¬ 
tions that are closely aligned with all of the 
recommendation’s steps and do not include 
components of other recommendations; these 
studies provide a direct test of the recommen¬ 
dation. 210 The consistent positive effects— 
including in studies that provide a direct test 
of the recommended practices—as well as the 
high internal and external validity of the stud¬ 
ies supporting this recommendation, indicate 
a strong level of evidence. 

Consistency of effects on relevant 
outcomes. 

Graduating school. The studies related to 
this recommendation demonstrated consis¬ 
tent positive effects in the graduating school 
domain. Seven of the eight studies that exam¬ 
ined outcomes in this domain found positive 
effects on high school graduation. 211 

Staying in school. Eleven studies reported 
outcomes in the staying in school domain, 212 
five of which found positive effects. 213 Four 
of the six studies that found indeterminate or 
negative effects in the staying in school domain 
were part of a single report on multiple sites, 


and the authors indicated that these were “low- 
intensity programs,” not the more intensive 
panel-recommended practices. 214 

Progressing in school. One study found 
positive effects in the progressing in school 
domain. 215 One study found indeterminate 
effects 216 in this domain, but it also found 
positive effects on staying in school. 

Details about the supporting evidence 
(studies that demonstrate positive 
effects) 

The remaining paragraphs in this section 
describe the nine studies that found positive 
effects in at least one domain (i.e., the studies 
that contribute to the strong level of evidence). 

Internal validity of supporting evidence. 

The studies supporting this recommendation 
have strong internal validity. Six studies were 
RCTs with low sample attrition that meet 
WWC group design standards without reser¬ 
vations. 217 One study was an RCT with high 
sample attrition that demonstrates baseline 
equivalence and meets WWC group design 
standards with reservations. 218 Two studies 
were quasi-experimental designs (QEDs) that 
meet WWC group design standards with 
reservations. 219 

Relationship between the evidence and 
Recommendation 3. Five studies support¬ 
ing this recommendation examine interven¬ 
tions that do not contain other intervention 
components, providing a direct test of the 
recommendation. 220 The other four stud¬ 
ies examine interventions that contain 
components that are critical to Recom¬ 
mendation 3, but are also related to other 
recommendations. 221 

External validity of supporting evidence. 

Eight studies compared the recommended 
practices to regular classes and activities 
in traditional middle and high schools, 222 
and one study compared the recommended 
practices to less intensive workshops. 223 The 
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length and intensity of the interventions 
varied, ranging from 27 one-hour weekly ses¬ 
sions to practices integrated throughout the 
school day for 4 or 5 years. The grade levels 
in which the interventions were implemented 
spanned from 7th grade through high school 


completion and beyond. 224 Collectively, the 
study samples represent a diverse group of 
participants that includes middle and high 
school students from schools across the 
United States. 


Table D.4. Studies providing evidence for Recommendation 3 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Meets WWC Croup Design Standards Without Reservations 

Berger et 
al. (2013) a 

Randomized 

controlled 

trial 

2,458 high 

school 

students 

10 Early Col¬ 
lege High 
Schools in 

5 states 
(urban 
areas, mid¬ 
sized cities, 
and small 
towns) 

Students attended Early College High Schools , 
which partnered with higher-education insti¬ 
tutions and offered curricula that allowed 
students to complete high school and obtain 
college credits simultaneously. The schools 
focused on college readiness and prepara¬ 
tion, as well as personalized and comprehen¬ 
sive supports to students. Early College High 
Schools are small, autonomous schools that 
serve grades 9-12 or 9-13 (4 or 5 years). Eight 
of the 10 schools were located on college 
campuses. 

Students partici¬ 
pated in regular 
classes and 
activities at 
traditional high 
schools. 

Graduating 
school = 

0.22* b 

Dynarski et 
al. (1998) 
(Albuquer¬ 
que Middle 
School 
Leadership 
Program) 

Randomized 

controlled 

trial 

290 8th- 

grade 

students 

4 middle 
schools in 
Albuquerque, 
New Mexico 

Students participated in the Albuquerque 

Middle School leadership program, a weekly 
workshop designed to build student self-esteem, 
academic skills, and/or leadership skills. 

Students partici¬ 
pated in regular 
classes and 
activities. 

Staying 
in school 
(cohorts 

1 and 2) = 
-0.33 c 

Dynarski et 
al. (1998) 
(Boston 

JFY High 
School) 11 

Randomized 

controlled 

trial 

212 high 

school 

students 

3 alternative 
high schools 
in Boston, 
Massachu¬ 
setts 

Students attended alternative high schools 
that provided a competency-based curriculum 
and enhanced social services, including career 
awareness, accelerated learning, and counsel¬ 
ing services. Students received individualized 
course schedules tailored to their needs, flex¬ 
ible schedules, and childcare. The schools were 
smaller than typical urban high schools and in 
a separate facility from other high schools in 
the district. 

Students partici¬ 
pated in regular 
classes and 
activities at 
traditional high 
schools. 

Staying 
in school 
(cohort 1, 
year 2) 

0.1 / 

Graduating 
school 
(cohort 1, 
year 2) = 

0.25 e 

Completing 
school (CED 
only, cohort 
/, year 2) = 
-0.09 
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Table D.4. Studies providing evidence for Recommendation 3 (continued) 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Dynarski et 
al. (1998) 
(Rockford 
Early Identi¬ 
fication and 
Intervention 
Project) 

Randomized 

controlled 

trial 

554 students 
in grades 

6-8 

4 middle 
schools in 
Rockford, 
Illinois 

Students in the Early Identification and Inter¬ 
vention Project enrolled in a daily class focused 
on building self-esteem, academic skills, and 
leadership skills. The intervention also pro¬ 
vided support services such as family outreach 
and counseling. One counselor, assigned to 75 
participants, implemented the program in each 
school. 

Students partici¬ 
pated in regular 
classes and 
activities. 

Staying 
in school 
(cohorts 1 
and 2) = 0.10 f 

Dynarski et 

al. (1998) 

(Sweetwater 

Twelve 

Together 

Program) 

Randomized 

controlled 

trial 

466 middle 

school 

students 

9 public 
middle 
schools in 
the Sweet¬ 
water Union 
high school 
district of 
Chula Vista, 
California 

Students participated in the Sweetwater/Chula 
Vista Twelve Together program, which offered 
weekly meetings facilitated by adult volun¬ 
teers, counseling, attendance monitoring, 
and an annual weekend retreat. The program 
focused on building self-esteem, academic 
skills, or leadership skills. 

Students partici¬ 
pated in regular 
classes and 
activities. 

Staying 
in school 
(cohorts 

1 and 2) = 
0.099 

Edmunds 
et al. 

(2015) h '' 

Randomized 

controlled 

trial 

1,594 high 
school stu¬ 
dents in 
grades 9-12 
or 9-13 

12 Early 
College High 
Schools 
in North 
Carolina 

Students attended North Carolina Early College 
High Schools , which partnered with higher- 
education institutions and offered curricula 
that allowed students to complete both high 
school and associate’s degrees simultaneously. 
The schools focused on college readiness, 
high-quality teaching and learning, personal 
relationships between students and staff, 
high expectations, and staff commitment to a 
shared mission. Early College High Schools are 
small, autonomous schools that serve grades 
9-12 or 9-13 (4 or 5 years). Teachers monitored 
students' progress and actively intervened to 
provide extra assistance when students’ grades 
dropped or they fell off track. 

Students partici¬ 
pated in regular 
classes and 
activities. 

Staying in 
school = 

0.40* J 

Graduating 
school = 

0.16* k 

Gonzales et 
al. (2014) 

Randomized 

controlled 

trial 

420 

Mexican- 

American 

7th-grade 

students' 

4 urban 
middle 
schools in 
the South¬ 
western 
United 

States 

Students in the Puentes (Bridges) program par¬ 
ticipated in 2-hour weekly sessions for 9 weeks, 
and their families received 2 home visits. The 
student sessions focused on increasing stu¬ 
dents’ abilities to imagine future possible 
selves, self-regulate, and develop coping strat¬ 
egies. They also sought to promote positive 
engagement with family members and peers 
to support the adolescents’ learning goals and 
school success. The family sessions focused 
on parenting strategies, improvement of par¬ 
ent-child communication, positive reinforce¬ 
ment, and schoolwork monitoring, all to 
facilitate school success. Parents also received 
information on the expectations of the school 
and strategies for effective parent-teacher 
communication. 

Students and 
their parents 
participated 
in one 1.5- 
hour work¬ 
shop. Students 
and parents 
received hand¬ 
outs on school 
resources, dis¬ 
cussed chal¬ 
lenges to school 
success, and 
developed their 
own plans to 
support school 
success. 

Staying in 
school = 

0.54* 
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Table D.4. Studies providing evidence for Recommendation 3 (continued) 


Study and 
design 

Partici - 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Heller et al. 
(2013) m " 

Randomized 

controlled 

trial 

2,740 male 
students in 
grades 7-10 

18 Chicago 
Public 

Schools 
middle and 
high schools 

Students participated in one of three interven¬ 
tion groups of the Becoming a Man (BAM) inter¬ 
vention: an in-school intervention group, an 
after-school intervention group, or both an in¬ 
school and an after-school intervention group. 
Consistent with the study, this practice guide 
combines these three intervention groups. 

The in-school intervention consisted of 27 
one-hour weekly sessions during the academic 
year. The sessions were offered in place of a 
traditional class during the school day. The 
instructors were college-educated and were not 
required to have specialized training. The cur¬ 
riculum components included elements of cog¬ 
nitive behavioral therapy. 

The after-school intervention consisted of 1- to 
2-hour sessions during the academic year. Each 
session included student participation in non- 
traditional sports and reflection on their behav¬ 
ior. The after-school coaches were trained in 
the intervention. 

Students received 
regular classroom 
instruction. The 
authors noted 
that there was 
a high level of 
crossover in 
which some of 
the comparison 
students received 
the intervention. 

Staying 
in school 
(2010-2011) 

= 0.15° 

Graduating 
school = 

0.19 P 

Heller et al. 

2,064 male 

9 Chicago 

Students participated in the Becoming a Man 

Students partici- 

Staying in 

(2015 ) q ' r 

9th- and 

Public 

(BAM) program, which consisted of weekly 

pated in regular 

school = 

Randomized 

controlled 

trial 

lOth-grade 

students 

Schools high 
schools 

1-hour group sessions for 2 years. The sessions 
were led by “counselors,” college-educated 
men hired and trained to deliver the estab¬ 
lished curriculum. The sessions used cognitive 
behavioral therapy and included reflection, 
role-playing, skill-building, and stories and 
discussion. Over the 2-year program, students 
participated in up to 45 sessions. (Attendance 
was not mandatory.) The sessions took place 
during the school day, and the students missed 
class to attend the program. In addition, after¬ 
school sports programming was offered in 5 of 
the 9 schools during the first year only. 

classes and 
school activities. 

0.11 s 

Johnson, 

268 9th- 

1 urban high 

Each student was assigned to a peer leader 

Students partici- 

Graduating 

Simon, and 

grade 

school in a 

upon entering 9th grade. Peer leaders were 

pated in regular 

school = 

Mun (2014) 

Randomized 

controlled 

trial 

students 

Mid-Atlantic 

state 

12th-grade students, and each was assigned 
to 12 freshmen. The peer leaders met with 
their groups of freshmen for 40-minute ses¬ 
sions weekly, during school hours, throughout 
the participants’ freshmen year. During these 
weekly group sessions, participants practiced 
academic, social and emotional skills, critical 
thinking, goal setting, decision-making, time 
management, teamwork, and communication 
via hands-on activities. Three 2.5-hour booster 
sessions were conducted during participants’ 
sophomore year. 

classes and 
school activities. 

0.27' 
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Table D.4. Studies providing evidence for Recommendation 3 (continued) 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Kemple 
(2001 ) uv 

Randomized 

controlled 

trial 

1,510 9th- or 

lOth-grade 

students 

10 schools in 

9 cities in the 
United States: 
Pittsburgh, 
Pennsylvania; 
Baltimore, 
Maryland; 
Washington, 
DC; Miami 
Beach, Flor¬ 
ida; Cocoa, 
Florida; 
Socorro, 

Texas; 

Santa Ana, 

California; 

Watsonville, 

California; 

and San Jose, 

California 

Students in Career Academies were part of 
small learning communities within larger high 
schools (school-within-a-school model). In each 
community, there were 3-5 teachers and 50-75 
students per grade in grades 9-12 or 10-12. 
Students took 2 to 4 courses per year in their 
academy, which focused on a career theme 
based on local employment needs. The schools 
established partnerships with employers who 
provided financial support, internships, and 
mentoring. Teachers were supported with 
professional development, and the academy 
curricula focused on helping students meet 
core academic requirements for graduation 
and college preparation. 

Most students 
attended regular 
classes within 
the same high 
schools, but 
some who were 
not selected for 
the Career Acad¬ 
emies elected to 
attend magnet 
schools or other 
options. 

Staying in 
school = 

0.14* 

Progressing 
in school = 
0.09 

Completing 
school (2004) 
= 0.07" 

Postsecondary 
access and 
enrollment 
(2000) = 0.05 

Labor market 
(2000) = 0.09 

Meets WWC Group Design Standards With Reservations 

Luna and 
Fowler 
(2011) 

Quasi-exper- 

imental 

design 

120 students 
in grades 
10-12 

3 high 
schools in a 
large district 
in Arizona 

Students participated in the Achieving a Col¬ 
lege Education (ACE) Plus program. They con¬ 
currently enrolled in high school and a local 
community college. Participants were selected 
during the spring of grade 9. 

Students in the 
comparison con¬ 
dition attended 
the same high 
schools but 
did not enroll 
in community 
college. 

Staying in 
school = 

0.86* 

Graduating 
school = 

0.55* x 

Postsecondary 
access and 
enrollment = 
0.67 * 

Neild, 

Boccanfuso, 
and Byrnes 
(2015) 

Randomized 
controlled 
trial that 
needs to 
demonstrate 
equivalence 

3,629 high 
school 
students in 
grades 9-12 

5 career and 

technical- 

education 

schools in 

Philadelphia, 

Pennsylvania 

Students attended one of five career and 
technical-education schools. These schools 
provided both traditional and career-related 
educational coursework. Four of these schools 
focused the career coursework on locally in- 
demand fields, such as auto repair and child¬ 
care, while the fifth focused on agriculture and 
animal care. 

Students 
attended tra¬ 
ditional public 
high schools 
beginning in 9th 
grade. 

Graduating 
school = 

0.11*'' 

Progressing 
in school = 
0.09* 

Warner et 
al. (2015) 2 ' aa 

Quasi-exper- 

imental 

design 

14,304 
high school 
students 

High schools 
in 8 school 
districts in 
California: 
Antioch, 

Long Beach, 

Los Angeles, 

Oakland, 

Pasadena, 

Porterville, 

Sacramento 

City, and 

West Contra 
Costa 

Students enrolled in a Linked Learning career 
pathways program, which consisted of compre¬ 
hensive programs of study within schools that 
combined classroom learning with real-world 
applications outside of school. The Linked 
Learning approach had four main compo¬ 
nents: (1) rigorous academics, (2) career-tech¬ 
nical education, (3) work-based learning, and 
(4) comprehensive support services. Pathway 
teams of teachers and staff worked together to 
establish communities and provide individu¬ 
alized support to students. Students enrolled 
in a pathway beginning in 9th or 10th grade 
and continued their enrollment until the end 
of high school. To become a Linked Learning 
career pathway, a program had to be certified 
by one of two organizations, ConnectEd or the 
National Academy Foundation (NAF). 

Students par¬ 
ticipated in 
traditional 
high school 
programs. 

Staying in 
school = 

0.17* 

Graduating 
school = 

0.16* bb 
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Notes: 

All studies in this table meet WWC group design standards with or without reservations. Within each rating section, studies are listed 
alphabetically by first author. 

Each row in this table represents a study, defined by the WWC as an examination of the effect of an intervention on a distinct sample. 

In some cases, multiple contrasts or studies were described in a single article. In these cases, the contrast or study that is most relevant 
to the recommendation is included in the table. 

For studies that included multiple outcomes in a domain, reported effect sizes and statistical significance are for the domain and calcu¬ 
lated as described in the WWC Procedures and Standards Handbook 3.0 (pp. 25-26). 

Several studies examined the dropout rate, which falls under the staying in school domain. These effect sizes were reported as nega¬ 
tive in the studies. In this table, the signs of the effect sizes for staying in school are reversed for clarity. A plus sign (+) indicates that 
the intervention had a positive effect on staying in school (or a reduced dropout rate), meaning the intervention group had a higher 
rate of staying in school than the comparison group. 

Italicized gray font is used for outcome domains (e.g., completing school, postsecondary access and enrollment, and labor market partici¬ 
pation) that are not directly related to dropout prevention and do not contribute to the level of evidence of this recommendation, but might 
be affected by dropout prevention practices and be of interest to educators and practitioners who are implementing these practices. 

* = statistically significant at the 0.05 level 

a This study is also used as evidence for Recommendation 4. Although another study on the Early College High School initiative, 
Edmunds et al. (2015), supports Recommendations 1, 3, and 4, Berger et al. (2013) does not include any information on teachers 
monitoring students, and therefore does not support Recommendation 1. 

b Overall graduation rate over the course of the study, which represents a different amount of time between 9th-grade enrollment and 
outcome measurement for each cohort. Cohort Ts graduation rate is measured 6 years after enrolling in 9th grade; Cohort 2’s graduation 
rate is measured 5 years after enrolling in 9th grade; and Cohort 3’s graduation rate is measured 4 years after enrolling in 9th grade. 

c The “highest grade completed,” an outcome in the progressing in school domain, was also examined and meets standards, but the 
study does not provide sufficient information to assess the magnitude or significance of effects. 

d This study is also used as evidence for Recommendations 2 and 4. 

e Graduation rate 2 years after the start of the program; students were 18 years old on average upon entering the program. 
f The “highest grade completed,” an outcome in the progressing in school domain, was also examined and meets standards, but the 
study does not provide sufficient information to assess the magnitude or significance of effects. 

9 The “highest grade completed,” an outcome in the progressing in school domain, was also examined and meets standards, but the 
study does not provide sufficient information to assess the magnitude or significance of effects. 

h This study is also used as evidence for Recommendations 1 and 4. 

1 The review of this study incorporates data from Edmunds et al. (2011) and information from Edmunds et al. (2010). None of the 
outcomes in Edmunds et al. (2010) meet eligibility requirements. 

j The staying in school outcome reported in this table is from Edmunds et al. (2011). The sample consisted of 676 students from 19 
Early College High Schools. This sample overlaps with the sample included in Edmunds et al. (2015). 

k Five-year graduation rate. 

1 Demographic information is reported only if the intervention was designed for and administered to a specific group of students. 
m This study is also used as evidence for Recommendation 1. 
n The review of this study included data from Study 1 in Heller et al. (2015). 

0 The reported effect is the complier average causal effect (CACE) effect. The intent-to-treat (ITT) effect size is 0.06 and not statistically 
significant. The study also reported enrollment status, which falls under the staying in school domain, for the 2009/10 school year. The 
CACE effect was 0.27 and not statistically significant, and the ITT effect was 0.10 and not statistically significant. 

p Four-year (“on-time”) graduation rate. The reported effect is the complier average causal effect (CACE) effect. The intent-to-treat 
(ITT) effect size is 0.08 and not statistically significant. The study also reports two other graduating school outcomes: graduating 
high school by the 2014/15 school year, 4-7 years after starting 9th grade (CACE estimate is 0.14 and not statistically significant; ITT 
estimate is 0.06 and not statistically significant), and graduating school with transfers counted as graduates (CACE estimate is 0.22 and 
statistically significant; ITT estimate is 0.09 and statistically significant). 

9 This study is also used as evidence for Recommendation 1. 

r The review of this study included only Study 2. Study 1 was reviewed in conjunction with Heller et al. (2013), and Study 3 is ineligible. 
s The reported effect is the complier average causal effect (CACE) effect. The intent-to-treat (ITT) effect size is 0.06 and not statistically 
significant. The ITT and CACE effect sizes for staying in school in year 1 are 0.03 and 0.06, respectively, and not statistically significant. 

' Four-year (on-time) graduation rate. 
u This study is also used as evidence for Recommendation 4. 

v This study was reviewed in conjunction with Kemple (1997), Kemple (2004), Kemple (2008), Kemple and Rock (1996), Kemple and 
Snipes (2000), and Kemple and Willner (2008). 

w The study reported completing school outcomes for one other time period, 2008. The effect size of 0.27 was statistically significant. 

* Four-year (on-time) graduation rate. 

y Four-year (on-time) graduation rate. The study also reports the 5- and 6-year graduation rates, but they did not meet standards. 
z This study is also used as evidence for Recommendation 4. 

aa This study also examines the effects of non-certified career pathways, which are not reported here. These programs typically share 
some characteristics with Linked Learning pathways, such as their focus on a career theme, but they vary in their implementation and 
fidelity to the Linked Learning approach. 

bb The study does not specify the timeframe of the reported graduation rate. 
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Recommendation 4. For schools with 
many at-risk students, create small, 
personalized communities to facilitate 
monitoring and support. 

Level of evidence: Moderate Evidence 

WWC staff and the panel assigned a moderate 
level of evidence based on six studies that 
meet WWC group design standards without 
reservations 225 and two studies that meet 
WWC group design standards with reserva¬ 
tions (see Table D.5). 226 Seven of the eight 
studies reported positive effects in at least 
one of the three primary outcome domains, 227 
and all six studies that examined outcomes in 
the graduating school domain found positive 
effects on high school graduation. 228 

However, only one of the studies that found 
positive effects evaluates an intervention that 
is closely aligned with all of the recommenda¬ 
tion’s steps and does not include components 
of other recommendations; only this study 
provides a direct test of the recommenda¬ 
tion. 229 Most of the supporting studies exam¬ 
ine a variation of the recommendation—the 
study interventions create small schools 
rather than small communities within exist¬ 
ing schools. Although the studies collectively 
demonstrate strong internal validity and 
demonstrate consistent positive effects on 
relevant outcomes, the level of evidence was 
rated as moderate because of limited align¬ 
ment with the recommendation’s steps and 
only one study that provides a direct test of 
the recommendation. 

Consistency of effects on relevant 
outcomes. 

Graduating school. The studies related to 
this recommendation demonstrated consis¬ 
tent positive effects in the graduating school 
domain. All six studies that examined out¬ 
comes in this domain found positive effects 
on high school graduation. 230 


Staying in school. The studies supporting 
the recommendation found a preponderance 
of positive effects in the staying in school 
domain. Six studies examined outcomes in 
this domain, 231 four of which found positive 
effects. 232 One of the studies that found inde¬ 
terminate effects overall demonstrated some 
positive effects for the second cohort, which 
suggests that the large-scale restructuring 
of a school may take time to show positive 
effects. 233 The other study that found indeter¬ 
minate effects on staying in school also found 
positive effects on graduating school. 234 

Progressing in school. Only one study 
examined outcomes in the progressing in 
school domain, and it found indeterminate 
effects in this domain, although it did find 
positive effects on staying in school. 235 

Details about the supporting evidence 
(studies that demonstrate positive 
effects) 

The remaining paragraphs in this section 
describe the seven studies that found positive 
effects in at least one domain (i.e., the stud¬ 
ies that contribute to the moderate level of 
evidence). 

Internal validity of supporting evidence. 

The studies supporting this recommenda¬ 
tion have strong internal validity. Six studies 
were RCTs with low sample attrition that 
meet WWC group design standards without 
reservations. 236 One study was a quasi-exper- 
imental design (QED) that meets WWC group 
design standards with reservations. 237 

Relationship between the evidence and 
Recommendation 4. Only one study sup¬ 
porting this recommendation examines an 
intervention that does not contain other inter¬ 
vention components and provides a direct test 
of Recommendation 4. 238 In addition, six of the 
studies—including the only study that provides 
a direct test of the recommendation—examine 
interventions that create small communities by 
establishing small schools. 239 Only one study 
examined an intervention that created small 
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learning communities within existing schools, 
as recommended in the guide. 240 

External validity of supporting evidence. 

All seven studies compared the recommended 
practices to regular classes and activities in 
traditional high schools. The grade levels in 


which the interventions were implemented 
spanned from 9th grade through high school 
completion and beyond. 241 Collectively, the 
study samples represent a diverse group of 
participants that includes minority and non¬ 
minority students from schools across the 
United States. 


Table D.5. Studies providing evidence for Recommendation 4 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Meets WWC Group Design Standards Without Reservations 

Berger et 
al. <2013) a 

Randomized 

controlled 

trial 

2,458 high 

school 

students 

10 Early 
College High 
Schools in 5 
states (urban 
areas, mid¬ 
sized cities, 
and small 
towns) 

Students attended Early College High Schools , 
which partnered with higher-education insti¬ 
tutions and offered curricula that allowed 
students to complete high school and obtain 
college credits simultaneously. The schools 
focused on college readiness and preparation, 
as well as personalized and comprehensive 
supports to students. Early College High Schools 
are small, autonomous schools that serve 
grades 9-12 or 9-13 (4 or 5 years). Eight of the 

10 schools were located on college campuses. 

Students 
participated in 
regular classes 
and activities at 
traditional high 
schools. 

Graduating 
school = 
0.22" b 

Bloom and 
Unterman 
(2013) c 

Randomized 

controlled 

trial 

14,969 
students in 
grades 9-12 

84 small 
high schools 
of choice in 
New York 

City 

Students attended small New York City public 
high schools. The schools provided students 
with rigorous academic experiences and per¬ 
sonalization. In addition, the small schools 
offered a variety of resources: community 
partnerships, new principals and teachers, and 
start-up funding. 

Students 
participated in 
regular classes 
and activities at 
traditional New 
York City public 
high schools. 

Graduating 
school = 
0.22* d ’ e 

Dynarski et 
al. (1998) 
(Boston 

JFY High 
School)' 

Randomized 

controlled 

trial 

212 high 

school 

students 

3 alternative 
high schools 
in Boston, 
Massachu¬ 
setts 

Students attended alternative high schools 
that provided a competency-based curriculum 
and enhanced social services, including career 
awareness, accelerated learning, and counsel¬ 
ing services. Students received individualized 
course schedules tailored to their needs, flex¬ 
ible schedules, and childcare. The schools were 
smaller than typical urban high schools and in a 
separate facility from other high schools in the 
district. 

Students 
participated in 
regular classes 
and activities at 
traditional high 
schools. 

Staying in 
school (cohort 
1, year 2) = 
-0.17 

Graduating 
school 
(cohort 1, 
year 2) = 

0.259 

Completing 
school (CED 
only , cohort 

1, year 2) = 
-0.09 

Dynarski 
et al. (1998) 
(Las Vegas 
Horizon 

High 

Schools) h 

Randomized 

controlled 

trial 

399 9th- and 

lOth-grade 

students 

4 alternative 
high schools 
in Las Vegas, 
Nevada 

The students attended alternative high schools, 
which offered individualized academic plans for 
each student. Students participated in coop¬ 
erative learning, small-group instruction, and 
hands-on experiences. They also received sup¬ 
port services and childcare as needed. 

Students 
participated in 
regular classes 
and activities at 
traditional high 
schools. 

Staying in 
school (cohort 
1, year 3) = 
0.25' 

Graduating 
school 
(cohort 1, 
year 3) = 

0.95 jk 

Completing 
school (CED 
only, cohort 

1, year 3) - 
-0.12' 
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Table D.5. Studies providing evidence for Recommendation 4 (continued) 


Study and 
design 

Partici¬ 
pants and 
targeted 
grade range 

Setting 

Intervention condition as implemented 
in the study 

Comparison 
condition as 
implemented 
in the study 

Outcome 
domain and 
effect size 

Edmunds 
et al. 

(2015) m " 

Randomized 

controlled 

trial 

1,594 high 
school 
students in 
grades 9-12 
or 9-13 

12 Early 
College High 
Schools 
in North 
Carolina 

Students attended North Carolina Early College 
High Schools , which partnered with higher- 
education institutions and offered curricula 
that allowed students to complete both high 
school and associate’s degrees simultaneously. 
The schools focused on college readiness, 
high-quality teaching and learning, personal 
relationships between students and staff, high 
expectations, and staff commitment to a shared 
mission. Early College High Schools are small, 
autonomous schools that serve grades 9-12 
or 9-13 (4 or 5 years). Teachers monitored 
students’ progress and actively intervened to 
provide extra assistance when students’ grades 
dropped or they fell off track. 

Students partici¬ 
pated in regular 
classes and 
activities. 

Staying in 
school = 
0.40*° 

Graduat¬ 
ing school = 
0.16* p 

Kemple 
(2001)i r 

Randomized 

controlled 

trial 

1,510 9th- or 

lOth-grade 

students 

10 schools in 

9 cities in the 
United States: 
Pittsburgh, 
Pennsylvania; 
Baltimore, 
Maryland; 
Washington, 
DC; Miami 
Beach, Flor¬ 
ida; Cocoa, 
Florida; 
Socorro, 

Texas; 

Santa Ana, 

California; 

Watsonville, 

California; 

and San Jose, 

California 

Students in Career Academies were part of small 
learning communities within larger high schools 
(school-within-a-school model). In each commu¬ 
nity, there were 3-5 teachers and 50-75 students 
per grade in grades 9-12 or 10-12. Students 
took 2 to 4 courses per year in their academy, 
which focused on a career theme based on local 
employment needs. The schools established 
partnerships with employers who provided 
financial support, internships, and mentor¬ 
ing. Teachers were supported with professional 
development, and the academy curricula focused 
on helping students meet core academic require¬ 
ments for graduation and college preparation. 

Most students 
attended regular 
classes within 
the same high 
schools, but 
some who were 
not selected for 
the Career Acad¬ 
emies elected to 
attend magnet 
schools or other 
options. 

Staying in 
school = 

0.14* 

Progressing 
in school = 
0.09 

Completing 
school (2004) 
=0.07* 

Postsecondary 
access and 
enrollment 
(2000) = 0.05 

Labor market 
(2000) = 0.09 

Meets WWC Group Design Standards With Reservations 

Herman et 
al. (2012) 

Quasi-exper- 

imental 

design 

1,516 high 
school 
students 
from 2 
cohorts 

8 small 
schools in 

Los Angeles, 
California 

The Alain Leroy Locke High School in Los Ange¬ 
les was transformed into a set of smaller col¬ 
lege preparatory academies (2 academies for 
cohort 1 in 2007, and 8 for cohort 2 in 2008). In 
addition to the new school structure, the model 
included recommended practices for how prin¬ 
cipals and teachers should fulfill the tenets of 
the school reform. The six tenets were as fol¬ 
lows: (1) small, safe, personalized schools; (2) 
high expectations for all students; (3) local con¬ 
trol with extensive professional development 
and accountability; (4) parent participation; (5) 
maximization of funding to the classroom; and 
(6) schools open later. 

Students 
attended other 
high schools in 
the district. 

Staying 
in school 
(cohort 1) 

= 0‘ 
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Table D.5. Studies providing evidence for Recommendation 4 (continued) 


Warner el 

14,304 

High schools 

Students enrolled in a Linked Learning career 

Students 

Staying in 

al. (2015)“' v 

high school 

in 8 school 

pathways program, which consisted of com- 

participated 

school = 

Quasi-exper- 

students 

districts in 
California: 

prehensive programs of study within schools 
that combined classroom learning with real- 

in traditional 
high school 

0.17* 

Graduating 
school — 

design 


Antioch, 

world applications outside of school. The Linked 

programs. 


Long Beach, 

Learning approach had four main components: 


0.16* w 



Los Angeles, 

(1) rigorous academics, (2) career-technical edu- 




Oakland, 

cation, (3) work-based learning, and (4) com- 





Pasadena, 

prehensive support services. Pathway teams of 





Porterville, 

teachers and staff worked together to establish 





Sacramento 

communities and provide individualized sup- 





City, and 

port to students. Students enrolled in a pathway 





West Contra 

beginning in 9th or 10th grade and continued 





Costa 

their enrollment until the end of high school. 

To become a Linked Learning career pathway, a 
program had to be certified by one of two orga¬ 
nizations, ConnectEd or the National Academy 
Foundation (NAF). 




Outcome 
domain and 
effect size 


Study and 
design 


Partici¬ 
pants and 
targeted 

grade range Setting 


Intervention condition as implemented 
in the study 


Comparison 
condition as 
implemented 
in the study 


Notes: 

All studies in this table meet WWC group design standards with or without reservations. Within each rating section, studies are listed 
alphabetically by first author. 

Each row in this table represents a study, defined by the WWC as an examination of the effect of an intervention on a distinct sample. 

In some cases, multiple contrasts or studies were described in a single article. In these cases, the contrast or study that is most relevant 
to the recommendation is included in the table. 

For studies that included multiple outcomes in a domain, reported effect sizes and statistical significance are for the domain and calcu¬ 
lated as described in the WWC Procedures and Standards Handbook 3.0 (pp. 25-26). 

Several studies examined the dropout rate, which falls under the staying in school domain. These effect sizes were reported as nega¬ 
tive in the studies. In this table, the signs of the effect sizes for staying in school are reversed for clarity. A plus sign (+) indicates that 
the intervention had a positive effect on staying in school (or a reduced dropout rate), meaning the intervention group had a higher 
rate of staying in school than the comparison group. 

Italicized gray font is used for outcome domains (e.g., completing school, postsecondary access and enrollment, and labor market 
participation) that are not directly related to dropout prevention and do not contribute to the level of evidence of this recommendation, 
but might be affected by dropout prevention practices and be of interest to educators and practitioners who are implementing these 
practices. 

* = statistically significant at the 0.05 level 

a This study is also used as evidence for Recommendation 3. Although another study on the Early College High School initiative, 
Edmunds et al. (2015), supports Recommendations 1, 3, and 4, Berger et al. (2013) does not include any information on teachers 
monitoring students, and therefore does not support Recommendation 1. 

b Overall graduation rate over the course of the study, which represents a different amount of time between 9th-grade enrollment and 
outcome measurement for each cohort. Cohort l’s graduation rate is measured 6 years after enrolling in 9th grade; cohort 2’s gradu¬ 
ation rate is measured 5 years after enrolling in 9th grade; and cohort 3’s graduation rate is measured 4 years after enrolling in 9th 
grade. 

c This study was reviewed in conjunction with Bloom, Thompson, and Unterman (2010). The analyses in Bloom, Thompson, and Unter- 
man (2010) did not meet WWC standards. 

d Four-year (on-time) graduation rate. 

e Effect sizes are calculated based on model-imputed data for students who had dropped out of school. 
f This study is also used as evidence for Recommendations 2 and 3. 

9 Graduation rate 2 years after the start of the program; students were 18 years old on average upon entering the program. 
h This study is also used as evidence for Recommendation 2. 

1 The study also reports the dropout rate under the staying in school domain for cohorts 1 and 2 in year 2 of the program: the effect 
was 0.22 and statistically significant. 

J Graduation rate 3 years after the start of the program; students were 15-16 years old upon entering the program. 

k The study also reports the graduation rate under the graduating school domain for cohorts 1 and 2 in year 2 of the program. How¬ 
ever, the WWC cannot calculate an effect size when the mean of one group (in this case the intervention group) is 0. 

1 The study also reports the GED completion rate under the completing school domain for cohorts 1 and 2 in year 2 of the program: the 
effect was 0.43 and not statistically significant. 
m This study is also used as evidence for Recommendations 1 and 3. 
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" The review of this study incorporates data from Edmunds et al. (2011) and information from Edmunds et al. (2010). None of the 
outcomes in Edmunds et al. (2010) meet eligibility requirements. 

0 The staying in school outcomes reported in this table is from Edmunds el al. (2011). The sample consisted of 676 students from 19 
Early College High Schools. This sample overlaps with the sample included in Edmunds et al. (2015). 

p Five-year graduation rate. 

q This study is also used as evidence for Recommendation B. 

' This study was reviewed in conjunction with Kemple (1997), Kemple (2004), Kemple (2008), Kemple and Rock (1996), Kemple and 
Snipes (2000), and Kemple and Willner (2008). 

s The study reported completing school outcome for one other time period, 2008. The effect size of 0.27 was statistically significant. 

’ The study also reported the effect on staying in school for cohort 2. The effect size was 0.1 B and not statistically significant. 

“ This study is also used as evidence for Recommendation 3. 

v This study also examines the effects of non-certified career pathways, which are not reported here. These programs typically share 
some characteristics with Linked Learning pathways, such as their focus on a career theme, but they vary in their implementation and 
fidelity to the Linked Learning approach. 

w The study does not specify the timeframe of the reported graduation rate. 
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